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ABSTRACT ^ . 

The purposes of this^ booklet are (a) to suggest the 
kinds of research needed to close the knowledge gap that now exists 
with respect tp coipetency based teacher education (CBTE), (b) to 
build a case for CBTE programs as cbntexts for research it) education 
and teacher education, and (c) to outline a fraiework for proceeding 
with basic research \n these areas. The booklet outlines four i 
different kinds of studies that need to be und'fertaken. These are (a) 
studies of alternative approaches to the lastety of teaching , 
coBpetencies; (b) studies^ to "collect information to facilitate broad 
policy-'lever decislonsj abput CBTE; (c) studies to search for new 
constructs and new ways of measuring constructs, to test models, and 
to search for pi^lnciples of instruction that can'be applied to- 
teacher education; and (d) studies to describe the development, 
structure, operation, and/or diffusion of programs. The remaining 
sections of the /booklet deal with ifcow CBTE programs can be organized 
so as to function' as'contexts for research as well as training^ and 
.how the program Af research m^ght best be implemented^ Two examples 
df programs ,which\are now functioning a5> research qontexis are 
described, and a plan for 'implementing the research and documentation 
program being call^^d for is outlined. An appendix is included which 
describes a competency based teacher education project for the 
Consortium of Southern Colleges for Teacher Education. (RC) 
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10. 

This should not lure individual researchers or institutions into thinking that practice- 
oriented studies are therefore easy to manage or without consequence to program operation. 
Just the opposite is the case. Yhey require a willingness on the part of students, faculty and 
adpiinistrators to engage in systematically designed program variations while keeping constant 
the learning outcomes desired from the program; they require that bone fide experimental and 
control groups be established and managed in such a vray that true treatment variations are 
in fact implemented; and they require that a reasonably large number of students be enrolled 
in a program in order to Qstabf ish the experimental and control groups needed. Finally, 
they require that measures of learning outcomes of the highest quality be obtained, and that 
both cost and benefit data be collected and submitted to analysis. These are not easy con- 
ditions^to achieve, but unless they are, practica-oriented studies would be better left undone. 

Practice-oriented studies have few bounds as to the kind of practice that is appropriate 
to be tested. They may deal with the relative cost and effectivdnessof competing instructional 
modules, in bringing about mastery of a particular concept or a particular skill; they m^v ^ 
deal with the relative cost and effectiveness of ^pervised micro-teaching as opposed to 
supervised in-classroom teaching in bringing about a particular set of skills or the demonstrated 
ability to perform a particular teaching function; or they may deal vvith alternative sets of 
procedures designed to bring about understanding of self as teacher, the only limits to be 
placed on practices to be tested would seem tp be those of size and significance: if a practice 
is so circumscribed as to not warrant the effort of a serious study of its effects, or if it is 
so large that it is best treated as a prograrr variation, then it probably should not ^ submitted 
to alFormal test of effect within the context of practice-oriented research. Extremely 
circumscribed practices would probably be treated better within the context of basic research, 
and extremely global practices within the coritext of policy research. 

Another characteristic of practice-oriented studies is their variability in design. While they 
must always involve at least two competing instructional conditions, and one or more commonly 
agreed to measure(s) of desired learning outcomes, they car\Jnvolv6 all possible combinations ' 
of experimental and control groupings and before-after treatment patterns of measurement. ^ 
They can also vary as to the number and kind of moderator variables to be controlled. Data 
can be taken, for example, only on such standard variables as age, sex, socioeconomic status 
and teaching experience, or extended to include measures on variables such as personality 
characteristics and the characteristics of the setting in wtiich instruction occurs. It is in 
the province of the researcher, of course, to move a so-called moderator variable to the status 
of an experimental variable, and block his experimental and control groups accordingly. 
The design of the recently popular trait-treatment interaction studies is a case in point. 

Given the range of options possible with respect to both the focus and design of practice- 
oriented studies, the suggestions offered in Table 2 as to the kind of criteria or dependent 
measures that could be used in such studies, the sources of variation to be controlled in them, 
and. the dimensions of cost and benefit data to be collected and analyzed must be viewed 
as illustrative only. / 

Although the conduct of practice-oriented studies of the kind being called for are not 
totally foreign to teacher educators. Peck and TMcker;{-1973) point out in their recent summary 
of the research on teacher education that the vast majority of such studies have occurred 
within the past ten years. They have also taken place in relatively few locations and, 
apparently, have had little influence on the manner in which teacher preparation programs 
across the nation are structured and operated. 

It is likely that two conditions account for this circumstandJ. First, experimental studies 
in teacher education have tended to be carried out in contexts that could tolerate the con- 
trol and manipulation they require. The best example of such a context is an instructor's 
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This paper has three purposes. The first is to suggest the kinds of research needed to 
close the knowledge gap that now exists with respect to competency-based teacher 
education. The second is to build a case for CBTE programs as unusually rich contexts 
for research in education and teacher education. The third is to outline a framework for 
proceeding with basic research in education and teacher education that carries with it 
thB hope of yielding information of greater utility to practitioners than it has in the * 
past. " ^ • 

The paper stems from the Experience of the directors of the USOE-sponsored elementary 
teacher education models projects in attepnpting to design and implement'CBTE programs 
ill their own institutions, or in attempting to help others do so. I.n the course of these 
efforts alt have experienced the frustration of not having sufficient information on which 
to base program design decisions; all have recognized that there is.littte hope of improving 
the quality of v^at is being done until there is increased knowledge of what vyorks and 
what does not woric; and all have felt concern about the rapid move to adopt CBTE. ^ 
programs without clear evidence that what is being adopted is any better than what has 
been in operation in th^ past. The program of research that has been proposed by the 
Consortium of CBE Ceriters is designed to overcome these shortcomings and, in the course 
of doing , move both education and ^cher education closer to a mode of operation that 
is empirically based. 

Because the research program that is proposed is designed to close the knowledge gap 
for educational policy makers and educational practitioners, as well as educational 
theoreticians and researchers, all sections ot the monograph may not be equally interesting 
to all readers. Persons concerned with broaci policy questiqhs about CB1 b, for example, 
or with questions bearing upon ^e decision to implement or not implement CBTE, may 
find the sections dealing with practice-oriented and basic research studies of little interest. 
Practitioners, on the other hand, as well as educational theoreticians and researchers, will 
probably find these sections to be of greatest interest, in the judgment of those who 
helped in the preparation of the paper, however, all of the broad categories of research 
dealt with are equally important, for each attends to a particular kind of research that will 
provide a particular kind of information that is critically neededjyy a particular set of 
people working within the arena of education and teacher education. 

Hopefully all of the recommendations outlined in the paper will in time be implemented, 
for until the knowledge gaps that are alluded to are reduced, there is little hope that 
education as a profession will be able to do in the United States what it has been asked 
to do. 



H. D. Schalock 
Monmouth, Oregon 
March, 1975 
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FOREWORD 1^ 

^ The Multi-State Consortium on Performance-Based Teacher Education is pleased to make availa- 
ble to interested readers this discussion of one of the issues of current import in the continuin^effort to 
improve teacher education. . • 

The Consortium u'lshes to acknov\ l^dge its gratitude to the National Consortium of CBE Centers for 
permission to publish and distribute the catalog. / 
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PARTI. BACKGROUND AND OVERVIEW 

A decade ago the language of competency-based teacher education (CBTE) did not 
exist. Now it is (ximmonplace. In the brief period since the completion of Phase I of ? 
the Elementary Models project, an educational development effort funded in 1969 by 
the National Center for Educational Research and Development, U.S. Office of Educatior^ 
apprq^xiifiately half of the teacher education institutions in the nation have be^un either 
^to operate) develop or plan-CBTE-type programs. Even more remarkable isjhe fact that 
within this same time period, approximately half of the states widiin the nation have 
adopted or are moving to adopt certification and accreditation standards that call for 
such programs, and the concepts of CBTE have begun to appear in the literature of education 
generally (Schmieder, 1973). * ^ 

It is fair to say that few innovations in the history of American education, especially . 
when they are as complex and far reaching as CBTE, have spread so far in such little 
time. 

\ ^ 

The Grpwth Of CBTE In The Absence Of Knowledge ^ 

Though a number of arguments have been advanced in support df the advantages of 
competency-based over traditional teacher preparation programs (Elam, 1971; Cooper, 
et al, 1973; Schmieder, 1973), it remains sdmewhat of a mystery as to why Ae American 
educational community has adopted the philosophy and procedures of CBTE so readily. 
CBTE does^of course, possess a number of features that are responsive to the times. 
It is responsive to the growing demand for educational accountability, for example, 
throu^ insisting that desired learning outcomes be made public, that performance 
standards be held for the objectives stated and that both stUdent and program success 
be measuredjn terms of the ability to meet such standards. It also possesses features 
that are responsive to the growing depiand for the personalization of instruction, the 
introduction^of relevance (through a field-based mode of operation) to the program, 
and the demonstration of program planning and operation. Even so, it is hard to believe 
that such features by themselves account for the phenomenal spread of the CBTE movement, 
since they are all features of program operation which have been available to the education 
community for a long while. 

Another feature of CBTE that 9cfds mystery to its history of adoption is the lack of 
unanimity lhat surrounds its meaning (Hamilton, 1973)i What CBTE is may be clear 
as it is defined at one institution and, at the same time, be radically different from an 
equally clear meaning of CBTE at another institution. Beyond the general agreement that 
the essential features of CBTE are the requirements that the objectives of instruction be 
made public, that performance standards in relation to those objectives be^made explicit, 
and that learning success be measured in terms of ability to meet performance standards 
that have been specified, CBTE me^ns different things to different people. To some it 



1 Competency-based teacher edfucation, performance-based teacher educatmn, and criterion- 
referenced teacher education are terms that often are used interchangeably. As a matter « 
of author preference, the competency based language is used in the present document. 

■ 



simply means the translation (^existing course content into an instructional mode that 
contains a clear statement of objectives, performance criteria, etc. To others it means the 
identification'of the skills of teaching, establishing performance criteria for those skills, 
and developing means of assessing performance in relation to them* To still others, it 
means identifying the outcomes expected from a teacher in a certificated teaching position, 
^^^tablishing the standards of performance expected in relation to those outcomes, and , 
then developing procedures for obtaining evidence of performance in relation to them. Suc|\ 
similarities and differences are imbedded in Stanley Elam's early and widely a^^cepted 
definition of CBTE: ^* 

in performance-based programs performance goals are 

specified, and agreed to, in rigorous detail in advance of instruc- 
tion. The.student must either be able to demonstrate his 
ability to promote desirable learning or exhibit behaviors known 
to promote it He is held accountable, not for passing grades, ^ 
but for obtaining a given level of competency in"p6rfdrming the / 
essential tasks of teaching; the training institution is itself held 
accountable for producing able teachers. Emphasis is on 
demonstrated product or output. (Elam, 1971, pp. 1 and 2.) 

• - • ^ 

Programs that vary in such fundamental ways obviously reflect differing vipws ss to 
what is meant by teaching competence and, in all likelihood, produce teachers who vary 
in initial ability to function effectively v^^ithin an ongoing school setting (Schalock, 
1974).2 - 

Whatever the factors that have attracted the educational community to the concepts 
of CBTE, the nature of the educational returns that can be.expected from the movement 
remairts at the level of projection. .While an increasing nun*er of institutions are establish- 
• irtg operational CBTE programs, there is as yet little evidence that tfie educational 
returns from such programs are greater than those from traditionally designed programs. 
It can be argued, of course, that because of assuned better preparation, or assumed 
better selection due to more stringfent progr.am exit requirements, prospective teachers \ 
going through CBTE programs will have yeater success 'as they enter the profession than\ 
will teachers frorp non-CBTE programs. As yet, however, no one knows this \n fact to 
be the case. 

Moreover, even if it should turn out that teachers from CBTE programs are q[iore 
successful as they enter the profession, what about long-term benefits? If it should be 
found that beginning teachers from CBTE programs have an advantage over begipning ^ 
teachers from traditional programs, would that advantage be maintained over time? Do 
CBTE programs actually lead to the selection of teachers that are going to be more 
successful in'effecting learning outcomes in children, or is there a catch-up phenomenon . 
that permits teachers from traditional programs to pull even .with, or even surpass in time, 
' the performance levels of their CBTE counterparts? 

These are critical questions that need firm answers, for the sake of both the profession 
at targe and thelmtitutions contemplating the adopfton of a CBTE mode of operation. 
And, like it or not, they'are questions that can be answered only through research. 



^ In the context of this discussion, it should be noted that another monograph is being 
prepared by the Consortium of CBE Centers that deals with the criterion problem in 
competency-based teacher education. It lists twenty six essential elements which cut 
across individual definitional differences found in CBTE programs. 
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Assuming for the moment that the education returns from CBTE ^are appreciably greater 
than the returns from traditional teacher education programs, there remains the question 
of the relationship of costs to benefits. At present we have only the barest of ddta on 
costs associated with a CBTE mode of operation (Hite, 1974; Schalock, Kersh and * 
Garrison, 1974), and in only one instance has an effort been made to show cost/benefit 
relationships (Kersh, Garrison and Schalock, 1974). There are also a host of questions 
that pertain to program operation. At present, for example, we have no firm evidence 
that one set of teaching competencies is more productiye of (earning in 6hilfiren than 
ahbtiier set; that one level of competency definition is Ijetter than another level; that 
one approach to program organization and instruction is better than another 4n bringing 
about desired competencies, etc., etc. 

The Rationale For A Position Paper On Research In 
Competency-Based Teacher Education At This Point In Time 

The preparation of the present paper stems from the experience of the elementary 
model directors in attempting to design and implement CBTE programs in their own 
institutions, or in attempting to help others do so. In the course of these efforts all have 
experienced the frustration of not having sufficient information on which to base program \ 
^^ign decisionj/all h^ve recognized that there is little hope of improving the quality of what 
is being done untihthere is increased knowledge of what works and what does not work; ^ \ 
and all have felt concern about the rapid move to adopt CBTE programs without clear '\ 
evidence that what is being adopted is any better than what ha:# been in operation m the ^ 
past, ' • , 

The program of research that is outlined in the pages that follow is designed to overcome 
these shortcomings, and in the course of so doing move botii education and teacher education 
closer to a mode of operation that is empirically based. | 
In addition to the pressing need to know, three other conditions have contributed to the j 
decision to present these ideas at this point in time. The first is that CBTE programs are / 
reaching a level of maturity that permits the required research to be carried out. Research 
on the effectiveness of alternative practices <5r procedures ih competency-based teacher 
education, for example, or research that compares the effects of comjjetency-based and non- 
competency-based programs, requires operational CBTE programs. Now that such programs 
art* coming into existence, the essential cohdition for such res^rch has been met. 

A second condition that has contributed to the decision to prepare the paper is the in- 
creasing demand for evidence as to costs and benefits associated with CBTE. Persons 
who control fimds in support of teacher education programs, and persons who have been led 
to expect significant chanoes in the educational systemas a function of CBTE programs, are 
demanding to see data in m\s regard. Providing such data is seen as a fundamental obligation 
of the Consortium of QBE Centers, as well as a necessary conditiorf for the survival of the CBTE 
movement generally. % 

A third factor that has contributed to the preparation of the paper is the inconsistency 
that presently exists between theoretical expectations and program implementation so 
far as a data based mode of operation is concerned. All of the CBTE elementary models 
cail^ for continuous program adaptation and for this adaptation to be based upon empirically 
derived cost and effectiveness data. With few e^^ceptions this basic tenet of the models has 
not been realized. 

The Content And Organization Of The Paper 

The paper outline four different kinds of studies that need to be undertaken if the know- 
ledge gap in relation to CBTE is to be closed for all concerned. These have been labeled 
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POLICY-ORIENTED STUDIES, PRACTICE-ORIENTED STUDIES, BASIC RESEARCH 
STUDIES, and DOCUMENTATION STUDIES. ^ 

Used in tto paperl'ollcy-Orlented Studies are cost-benefit studies that have-as their 
purpose the collection of information tfiat facilitates broad policy*l6vel decisions about CBTE, 
particularly at the state and federal levels. Two categories of policy -oriented research are 
proposed: (a) research that compares the costs and benefits of competency-based and non- 
cbmpet6ricy*based programs; and (b) research that compares costs and benefits of CBTE 
programs thiat differ in major respects. ' ' ^ 

By contrast Practice-0ri(9nted Studies are seen as cost-effectiveness studies of alterriative 
"^proaches to the mastery of teaching competencies within the context of CBTE programs. 
In some respects, information comiitg f rom>such sUidies is of interest to policy makers, for 
it be^ upon the broader issue of program costs and benefits. Generally speaking, however, 
the results of such'studies are of primary interest to program desijgners and operators for 
they deal with a level of detail that policy makers are rarely able to consider.^ 

Four broad categories of basic research are dealt vvith irl^e paper. The first two of these 
are the most fundamental of activities in any'ciiscipline or profession: (1) the search for new 
and ever more povrarful constructs; and (2) the search for new and ever more povirerful > 
ways of measuring constrticts. The last two categories deal with thct kinds of activities 
most commonly associated with the label basic research: (3) the testing of models (theoriw); 
and (4) the search fof what hat been labeled in the principles of instruction that 

can be applied in education or teacher education. ^ ^ . « ; 

The decision tb devote so much of the paper to the matter of basic research siems 
from three conditions: the^central rote that such research plays in the advance of any 
discipline or profession; the generaflack of understanding on the part of educators and teacher 
educators as to the nature and function of such researdi; and the downright anifnosity that 
many hold'toward such research. ' \ ' 

ThrproposaRo carry out documentation studiej^is in response to the need for usable ' 
case histories by persons responsible for the development and implementation of CBTE 
programs. Because of the relative complexity of such programs, and because of the general 
lack of familiarity wit^ many aspects of their operation, help needs to be given at a nuts 
and bolts level to persons who wish to implement them. Documentation studies are seen 
as providing this kind of help. 

Three kinds of documentation studies are called for: one which. describes the development 
of programs; one which describes ^e structure and operation of programs; ancji one which 
describes tfie diffusion of programs. J 

The remaining^ sections of the pa|ier deal vWth how CBTE programs can be organized so 
as to function as^ntexts for researdi as weir as training, and how the program of research 
and documentation being called for might be implemented. CBTE programs represent 
unusually promising contexts for educational research in that they are rich' in data. As a 
consequence, if properly organized, they represent contexts wherein research can be carried 
out at low cost and high external, as well as internal, validity. Two examples of programs 
that are now functioning as research contexts are described. A plan for implementing the 
research and documentation program that is being called for is outlined against a three-. 



^ It should bejioted that information coming from policy and practice oriented studies is 
as applicable to non-CBTE programs as it is to programs that reflect CBTE characteristics. 



five-, and ten-year time frame. 




PART II. POLICY-ORIENJED STUDIES ' 

Persons responsible for the allocation of resources in support of teacher education need 
to know whether the educational returns from CBTE programs are greater than those from 
traditional programs, whether the costs associated with CBTE programs are greater than those 
associated with traditional programs, and ^j^lation of costs to benefits in both cases. 
Information of this kind is needed by persons responsible for establishing state and national 
standards for teache^ preparation programs^ by instftutional executives who must allocate 
resources in supp^of programs, and by employees of the federal government who must 
recommend or make policy relative to the funding of federally sponsored activitie^.that 
relate to such programs. Without such information, policy decisions must be made of 
necessity, on some basis other than fact. 

As indicated previously^ two fines of research need to be undertaken in order to obtain 
information that facilitatps policy decisions. The first involves the comparisbn of CBTE and 
non-CBTE programs as to^josts and benefits. Studies of this kind would seem to be of 
foremost importance for decision making at a state and national level, though obviously 
desirable at an institutional level,' for they deal with the two major factors that must be 
taken iftto accounit in policy decisions at any level. The isecond also involves cost-benefit 
comparisons, but nstead of comparing CBTE and non-CBTE programs, comparisons need to 
be made between CBTE programs that defiw^ teaching competencies or employ program 
practices and procedures in markedly different ways. Studies of this kind represent an 
extention of the CBTE/non-CBTE desiJin and need to be carried out in order that program* 
' designers have th^ kind of information they neeS to make decisions about program structure, 
focus and operation, ^r ^ase of reference, these two designs are referred to hereafter as 

. c CBTE/Non-CBTE design, and ' 

. a CBTE Program Variations design. . > 
Before co>isidering the characteristics ^f these two designs in greater derail, it is important 
to understand that three conditions are essential to the implementation of either. These are 
(^) the criterfa that define and differentiate desired program variations mOst be clearly * 
specified/ (b) ongomg teacher education programs must exist that meet these specifications; 
and (c) persons responsible for such programs must be willing to take part in research that 
' compares program effectiveness. Put on other terms, cost-benefit studies of teacher pre- 
paration programs of any kind require: f ^ . 

1 clarity as to what constitutes program differences to be compared * ' 
2. essentially pure cases of mature, fully functional programs that reflect 
these differences ' . 

! 3. teacher educators willing to submit themselves and their institutions 

to a comparative research effort. , 

Given these conditions, policy-oriented studies in the arena of CBTE will most likely 
take the form of natural field experiments; that is, systematic comparisons of desired 
variations that can be identified in already established programs. 



^ By recognizing the characteristics of policy-oriented studies, policy makers should be 
understanding of why research of ttjis kind has not been carried out in the past and why it 
is possible only now to begin it: until now CBTE programs have not'exis^ed at a level of 
operation that enabled m^ar'ngful comparative research to be carried out! Considering 
the relatively brief history of tf.e idea of CBTE, and the relative^absence of fdnds to support 
the development and operation of CBTE^programs, it is in some respects remarkable that 
development has proceeded to the point where comparative research H even now possible. 
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CBTE/Non-CBTE Studies 

' • 

The most critically needed p(5l icy oriented studies involve the comparison of CBTE and 
^Xnoi(i*CBTE programs. Because there are major differepces within both approaches to teacher 
preparation, however, and these differences may be as significant in terms of cost/benefit 
relationships as the differences between such programs, policy-oriented studies of this kind 
must include a sa'hipling of the major variations that appear within both CBTE and non-CBTE 
programs. ^ the CBTE side, this would probably involve the selection of programs that 
focus instrAion primarily at the level of knowledge mastery, skill mastery, and the 
ability to pmbrm the job of a teacher in a school setting.^ On the non-CBTE side it would 
probably jnvm^e the seiecdon^of programs that reflect the classic, discipline^centered four- 
year undergraduate approach to teacher education, the ph^nomenological approach 
to teacher education, and perhaps the Master of Arts (MAT) or the Teacher Corps approach 
' to teacher education. These variations in CBTE and non-CBTE program designs are shown 
schematically in Table 1: 

While connlparative studies of/^BTE and non-CBTE programs are critically needed, im- 
plementing s|jch studies is likely to be fraught with problems. The matter of defining and. 
then finding pure cases of either CBTE or non-CBTE program variations, for example, is \ 
likely to be a piajor stumbling block. So too is obtaining comparable outcome measures 
for all teachers or prospectiye^teachers taking part in such studies, or being able to isolate 
and control fac^tors tiiat will act as sources of unwanted variation, for example, major 
personality, background or ability-differences^ in teachers. Finally, there are the related 
problems of collecting data for and carrying out analyses on cost-benefit relationships. 
Methodology in this arena js primitive, and experience in applying the methodology that 
does exist is hard to cohfie by, I \ 



Dominant Variations In CBTE Programs 



Dominant Variations In Non-CBTE Programs 



Knowledjge- Skill- Job Performance 
Centered Centered Centered Defi- 
Definition Definition nition^of Com- 
ofCompe- ofCompe-. petency 
tency tency 
' 

' - Table 1. Variations that need to be taken into account when 
\ ^ comparing CBTE and non-CBTE programs. 



Classic Four* Phenomeno- MAT or 
Year Under* logical Four- Teacher Corps 
gpaduate Year Under- > Approach 
Approach graduate 
Approach 



Givei( the prqblems likely, to be^encountered^n such studies, their design is likely to 
assurhe some special characteristics. One of these is a siTiall number of cases in each ceAl, 
possibly only thrte to five, - Another is the limitation of such studies, at least during tBe 
next few years, to elementary teacher preparation programs, for it is doubtful that there are 
,^nough CBTE programs at the secondary level to permit a design requirement of even three 
programs per ceil to be met. 

Still another characteristic of CBTE/Non-CBT^ studies is the high cost of carrying them 
out. Field-based follow-up resiearch is an expensive enterprise, particularly so where the 



^ According to Turner's criteria for classifying the focus of CBTE programs {Turner, 1972), 
knowledge-centered programs focus at level six; skill-centered programs at levels five, l^our/ 
or three; and job performance-centered i^rograms at levels Jwo or one. 
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Table 2. Dependent Measures JSources of Variation to be Controlled 
and Cc»t'Benefit Data To Be Collectea^»n A CBTE/non-CBTE 
Comparative Research Design 

^— ^ -4— - 



DEPENDENT MEASURES 



Short Term 



MEASURES OF TEACHH4GJFFECTIVENESS: 
Job performance measures of the kind employed 
by Oregon College of Education in their as- ^ 
sessment of competency in short terfh (2-5 
days) or extended {2-5 weeks) full-respon- , 
sibilsty teaching. (these measures include 
data on the ability of a teacher to bring about 
desired learning outcomes and atfitudinal, 
changes in pupils). ^ 

MEASURES OF SPECIFIC TEAQI^ING BE- 
HAVIORSbR SKILLS, IF DESIRED . 

' MEASURES OF ATTITUDES TOWARD 
TEACHING AND THE PROFESSION OF 
EDUCATION 



Long Term 



MEASURES OF TEACHING EFFECTIVENESS: ' 
Job performance measures of the kind employed 

by Oregon College of Education in their »- 

sessment of competertcy in long term (2-5 months) 
ojr continuing (2-5 yea^) full-responsibility 
teaching (these measures include data on pupil 
beh^ivior. attitudes and /learning gains). 



MEASURES OF SPECIFIC TEACHING BE- 
HAVIORS OR SKILLS IFDES^RED 

MEASURES OF ATTITUDE^WARD 
TEACHING AND THE PROf ESSION OF 
EDUCATION 

MEASURES OF PERSONAL* GROWTH AND 
'SATISFACTION ^ 



COST DATA TO BE COLLECTED 



Instructional costs 
Competency cessment costs 
Program assessment and redesign costs 



BENEFIT DATA 

Sh ort Term \ 

= — > - \ 

For preparatory or beginning teachers 

or school supervisors 

For cooperating schools and school 

districts as a whole . 

For college faculty and supervisors 

For the teaching^rofession as a whole 



. Program managenoent costs 
. Program governance costs * 

\ 

TO B| COLLECTED 

Long Term ^ 
. For preparatory or beginning teachers 
. For school sapervisors 
. For cooperating schpols and school 

\listricts d& a whole 
. For cbllege faculty and supervisors 
. For the teaching profession as a whole ^ 



SOURCES OF VARIATION TO.BE CONTROLLED 



Match between program design, program 
operation and definitional criteria. 

Number of stud:ints graduated through 
* the program [ 

Level of preparation offered by the 
program, e.g., preparation for 
elementary teaching 



Kind of institution within whjch the program 
rests, e.g., private small college, private 
large university, public small college, 
public large university 

Qeographic location 
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collection of high-quality job performance data for a large nurr^er of subjects is involved * 
(an initiaj sample of 100 teachers from each program represented in the study would probably 
be required in order to complete a five-year follow-up study with an N of any size). 

In combination, the$e considerations lead* to the conclusion that cost-benefit studies 
which have consequence for broad policy decisions about CBTE will prob-^hlv have to be 
done on a nation-wide scale. Resource and program access requir Jittle alternative. 

So far as can be determined, no such study is being planned and, i ; exception of a 
study group assembled by AACTE, is not even being considered. Preliminary thinking about 
the design of such a study is summarized in Table 2. 

CBTE Program Variation Studies, 

Studies of this kind represent an elaboration of the CBTE portion of the design described 
above. In the design proposed for the comparison of CBTf and non-CBTE programs, it 
was recommended that CBTE programs vary by level of competency definition. The CBTE 
Program Variation design calls for this kingl of differentiation to be carried one step further, 
and explore within level differences as well. 

The-costs and benefits of at least two kinds of vi^iihin-level difference? in CBTE programs 
need to be explored. One of these differences has to do with the content or substance of 
a program. It is possible for two programs, for example, to define teaching competence 
esserltially in terms of skills or behaviors to be performed, but in so doing, str^ totally 
different sets of behaviors. The consequences of such differences should be known. 

The other has to do with the structure and operation of a program. It is possible for two 
programs to stress essentially the same content but provide quite different learning experiences 
on the way to mastering that Content. A case in point is the use of individualized learning 
modules^.as opposed to lecture, reading and class discussion as a means of knowledge acquisi- 
tion. Another js the use of micro-teaching or ^ome other form of simulated practice ex- 
perience as opposed to field placement and supervision as a means to skill acquisition. 
Since such differences have niajor cortsequences for program cost ^ey need to be studied for 
their cost-benefit relationships. 

Operationally, carrying out studies that represent the CBTE Program Variations design 
requires that the same conditions be met as needed to carry out studies representing the CBTE/ 
Non-CBTE design. Mature CBTE programs of varying foci and emphases must be available; 
people in these programs must be willing to engage in a comparative study; the same unwanted 
Sources of^variation must be controlled; the same kind of dependent measures must be taken; 
and the same kinds of program cost and benefit analyses must be made, "^he fundamental 
^listinction^ between the two designs is in thekind of program differences that get tested: in 
one^Jhe difference is between CBTE and non-CBTE program variations of a very general, 
nature; in.the ovher, the difference^ is betwgen CBTE program variations of a more spefcific 
nature, but still not so s^iecific as to cast them as PRACTICE-ORIENTED studies (see pp. 
9 to 13). . I ^ \ 

Another important diffe^nce between the two designs that have been proposed is that 
many individual institutions have the resources ahd capabilities needed to carry out Program 
Variations studied yyhile few are able to manage -for political and financial reasons-CBTE/ 
non-CBTE studies. i ^ ^ 

Unfortunately, givpn the relatively limited developm^t^of^QBTE programs nationally, 
it is likely lhat the CBTE Program Variations design will be ap^licaWejn^the foreseeable 
future only to programs that define competence at the knowledge and skilTtevel^^ Jhete 
simply are not enough CBTE programs now operating that define competence at thejob 
performance level to permit the comparison of the effects of alternative program emphases ^ 
to be meaningful. • . - 



PART III: PRApTICE-ORlENTED STUDIES 

mh. ^oiicy makers need the kind of information allud^ to above, persons responsible 
for the.development and implementation of Cl^ programs need a different kind of 
information. Obviously, they must also be concerned wittvfcost and benefit questionsrbut 
the centt-al focus of program developers and managers is the effectiveness o^ alt^rnativ.e 
instruct -nal programs and procedures in bringing about a specified set of/earning outcomes. 
Without such information, decisions as to program design and operation must also be based 
on something other than fact. / 

^ used in th^ present paper, practice-oriented studies are designed to bring about such 
informatioTi. Generally ^speaking, the design of practice-oriented studies is much like the 
design of CBTE program. variations studies. They diff^, however, in several important 
ways: • ' ^ ^ . 

. First, practice-oriented studies are designed to t^t the cost^ffectiveness of tWp . . ^ 

or more instructional programs in bringing about a^pa rticular learning outcome; 

Second, they require more careful* control over unwanted sources of variation 

than program variation designs because the effects to be tested are vrore sharply 

targeted (the rifle vs. shot-gun analogy); and^^ 
. Third,they do not require for their conduct full blown, fully operational 

CBTE programs. 

These differences in turn have two major consequences for the conduct of such studies: 
(a) the resources required are such that individual instructors or individual Institutions can 
carry them out; and (b) the constraints on program operation due to the demand for control 
over unwanted sources of ^variation are such that they cause persons or programs to back , 
away from such studies, or the aspects of programs to be researched are so limited In scope 
that little of practical impoitance comes from them. These features of practice-oriented 
studies need to be fully appreciated before individuals or institutions go too far in committmg 
themselves to engage in such research. ^ 

As in the case of policy-oriented studie%lwo conditions must be obt^ned before 
practice-oriented studies can be implemented. First, programs must be in operation which 
reflect the practice(s) of concern: Second, either programs. must be found that are comparable 
in structure, organization and student body and that are willing to compare alternative 
practices under experiemental conditions. Given these conditions, practice-oriented studies 
typically assu/ne the form of systematically manipulated f ielc^ experiments, in contrast to 
the natural field experiments that characterize policy-oriented studies. 

* <* « 

Intra-lnstitutional Studies 

Since program practices and procedures work their effects through interaction with learner 
characteristics and kind of learning outcbme desired (see p. 19 for a model of instriiction 
that portrays this interaction), it is probably best to carry out most practice-oriented studies 
• within the context of a particular program or institution. There are advantages and disadvantages 
to this strategy however. On the positive side, it permits" a researcher to more easily control 
the many sources of unwanted variation in such studies, for example, major differences in 
leprner characteristics and the conditions under which an insi'uctional practice is adtijinistered. 
On the negative side, it reduces the generalizability of findings. Given the rule, however, 
that practice-oriented studies should be replicated in at least three contexts before treating 
the data on effects as trustworthy, the advantz^s gained from carrying out such studies with- 
in the context of particular programs or institutions outweigh the disadvantages. 
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This should not lure individual researchers or institutions into thinking that practice- 
oriented studies are therefore easy to manage or without consequence to program operation. 
Just the opposite is. the case. Yhey require a willingness on the part of students, faculty and 
adp^inistrators to engage in systematically designed program variations while keeping constant 
the learning outcomes desired from the program; they require that bone fide experimental and 
control groups be established and managed in such a way that true treatment variations are 
in fact implemented; and they require that a reasonably large number of students be enrolled 
in a program in order to ^tabf ish the experimental and control groups needed. Finally, 
they require that measures of learning outcomes of the highest quality be obtained, and that 
both cost and benefit data be collected and submitted to anal^is. These are not easy con- 
ditions\to achieve, but unless they are, practica-oriented studies would be better left undone. 

Practice-oriented studies have few bounds as to the kind of practice that is appropriate 
to be tested. They may deal with the relative cost and effectiven^sof competing instructio nal 
modules in bringing about mastery of a particular concept or a particular skill; they n\a\f ^ 
deal with the relative cost and effectiveness of aojpervised micro*teaching as opposed to 
supervised in-classroom teaching in bringing about a particular set of skills 6r the demonstrated 
ability to perform a particular teaching function; or they may deal with alternative sets of 
procedures designed to bring about underspending of self as teacher. The only limits to be 
placed on practices to be tested would seem tp be those of size^nd significance: if a practice 
is so circumscribed as to not warrant the effort of a serious study of its effects, or if it is 
so large that it is best treated as a prograrr variation, then it probably should not oe submitted 
to alFormal test of effect within the context of practice*oriented research. Extremely 
circumscribed practices would probably be treated better within the context of basic research, 
and extremely global practices within the coritext of policy research. 

Ani^ther characteristic of practice*oriented studies is therr variability in design. While they 
must always involve at least two competing instructional conditions, and one or more commonly 
agreed to mea$ure(s) of desired learning outcomes, they carUnvolve all possible combinations 
of experimental and control groupings and before-after treatment patterns of measurement. ^ 
They can also vary as to the number :ind kind of moderator variables to be controlled. Data 
can be taken, for example, only on such standard variables as age, sex, socioeconomic status 
and teaching experience, or extended to include measures on variables such as personality 
characteristics and the characteristics of the setting in wliich instruction occurs. It is in 
the province of the researcher, of course, to move a so-called moderator variable to the status 
of an experimental variable, and block his experimental and control groups accordingly. 
The design of the recently popular trait-treatment interaction studies is a case in point. 

Given the range of options possible with respect to both the focus and design of practice- 
oriented studies, the suggestions offered in Table 2 as to the kind of criteria or dependent 
measures that could be used in such studies, the sources of variation to be controlled in them, 
and the dimensions of cost and benefit data to be collected and analyzed must be viewed 
as illustrative only. / 

Although the conduct of practice*oriented studies of the kind being called for are not 
totally foreign to teacher educators. Peck and Tucker^1973) point but in their recent summary 
of the research on teacher education that the v^t majority of such studies have occurred 
within the past ten years. They have also taken place in relatively few locations and, 
apparently, have had little influence on the manner in which teacher preparation programs 
across the nation are structured and operated. 

It is likely that two conditions account for this circumstandST. First, experimental studies 
in teacher education have tended to be carried out in contexts that could tolerate the con- 
trol and manipulation they require. The best example of such a context is an instructor's 
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Table 3. Dependent Measures, Sources of Variation To Be 
Controlled, And Cost-Benefit Data To Be Collected 
In Practice-Oriented Studies 



DEPENDENT MEASURES 

Sh ort Term Long Term 

MEASURES OF DESIRED LEARNING OUTCOMES: Probably none, though this will depend 

Whatever measures of knowledge, skill nrostery, on the program element being tested, 

attitudinal change or the ability to perform the func- If the learning outcomes of a 

tions of teaching that a particular program has particular program element are ex^ 

adopted as the criterion for exit from the element pected to be traceable in a fulhtirne 

of the program being tested. teaching situation, researcher may 

want to include long term measures. 

REACTIONS TOTHE PROGRAM ELEMENT: 
Whatever measures of interest, meaningfulness , 
acceptability, time requirements, resource 
requirements, etc. that are of interest. 

COST DATA TO BE COLLECTED; 

. Instructional costs . Program tnanagement costs 

. Learning outcome assessment costs . Program governance costs 

BENEFIT DATA TO ^E COLLECTED 

Sh ort Ter m Long Term 

— ■ f 

. For preparatory or beginning teachers • For preparatory or beginning teachers 

. For school supervisors • For school supervisors 

. For cooperating schools and school • For cooperating schools and school 

district as a whofe district as a whole j 

. For college faculty and supervisors . For college faculty and supervisors 

. For a college as a whole . For a college as a whole 

. For the teaching profession as a whole . For the teaching profession as a whole 

SOURCES OF VARIATION TO BE CONTROLLED 

. I nitial differences in treatment groups j - ^^^^ equivalent^ntexts for 

. Unwanted variation in treatment \; outcome measurement/ 

conditions ^ \ ^ ^ 

/ ' ' ' 

/ V 
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pwn class. Second, It has tended to involve practices that are narrowly conceived or limited 
in scope, for example, practices that cover a day or a week of instruction, a particular grading 
practice or a particular set of role relationships between instructor and student that are to 
be tried for a term. Both strategies seem to stem from the fact that practice oriented studies 
make severe demands on the control of unwanted sources of variation, in both treatment 
conditions and outcome measures. The consequence of employing such strategies has been 
results of limited utility and generalizability, even within the context where the studies are 
carried out. 

These a.*e problems that have plagued educational researchers for decades, and only now 
are we coming to understand what must be done to overcome thenrt B^ically they are 
problems that have to do with the external validity of edtrdational experiments (Bract and ^ 
Glass, 1968; Snow, 1974). Schulman speaks to such problems pointedly when he says: 



Researchers are caught in a bind. To maximize the internal validity of 

experimen^, they develop carefully monitored settings within which 

they can gojiern their research. Thi$ has long been recognized as a 

necessity ,~Dut if is likefy that the experimental tradition in American 

education over-emphasized the importance of reliability and precision ( « 

at the expense of the characteristics affecting that other factor of equal 

importance (external validity) ... It is not siKfictent that the individuals 

studied as a sample are truly representative of that human population to 

which the results mist also ascertain that the experimental conditions 

can serve external conditions of interest That is, researchers must aisp 

attempt of maximize the similarity between the conditions in which 

they study behavior arid those other conditions, whatever they may be, . 

to v^ich researchers may ultimately wish to make inferences. The 

similarity should hold between psychologically meaningful features of 

the settings, not merely between the manifest aspects of the two situations. 

(1970, p. 377) 

If Shulman's analysis is correct, three fundamental shifts in the nature and focus of 
educational research must take place if it is to be responsive to the criterion of external 
validity: (a) a shift in emphasis from the sampling of people to the sampling of educational 
environments; (b) a shift from the study of single; isolated variables to the study of the 
complex of variables that tmke up ongoing educational environments; and (c) a shift from 
piecemeal, unrelated, one shot research efforts to studies that are articulated through time, 
theory, and problem focus. 

it is the contention of those who have prepared the present document that CBTE programs 
provide the kind of contexts where such shifts for the first time have some hope of coming 
about. Descriptions of two such contexts, and the research programs that are projected 
• within them, are provided in PART V! of the document. 

Having said all of the aboyer it is important to point once more to the fact that the conduct 
of long-term, multi-faceted; contextually valid, experimental research lays heavy demands 
on an ongoing educational jcot^text, and unless the context is special in many ways, such 
demands will not be met. In the judgment of the committee at least five conditions must 
prevail: . 
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. Persons res ponsible for the management and operatio n of the program 
must be inclined toward experimentation. Commitment to empiricism 
and the desire to know must be dominant features of the context. 
Research must be viewed as an integral part of program operation, 
and as such viewed as a continuous, necessary and desirable part of 
t the program. , 

. Persons responsible for the management a nd operation of the education 
program must view it as subject to continuous change, and view as a 
major data source for its change a systematically designed program of 
research on its effectiveness . When viewed in this way, research can 
have both the immediate and applied value that it needs to be supported 
by those responsible for program operation. 

/ 

Data of a quality that will support trustworthy research must be collected 
as a normal part of program operation. Accurate^ reliable descriptions 
of program operations must be provided and accurate, reliable measures 
of learning outcomes must be recorded as a matter of course. 

. Sophisticated data management storage, retrieval and disp la y capabilities 
must be available . Data to be used for research, program operation and 
program adaptation purposes must be routinely stored on computers and 
routinely retrieved in formats that support program related decisions 
making and research. 

♦ 

• There must be an advisory structure to insure that the research pursued 
h as vaftie to persons in the program as well as to the profession at 
large. 

It is recognized that thepe five conditions represent an unusual array of features to find 
in any ongoing educational context today. It is also recognized that they are difficult 
conditions to bring about if they are not already in existence. It is the judgment of the CBE 
Centers research committee, however, that CBTE programs represent the most hopeful 
development in the history of education for such conditions to be met. 

inter-Institutional Studies 

While most practice-oriented studies will be carried out within a particular institution, 
at least initially, ^he continuing concern for. the utility and general izability of the results 
of such studies requires that they be replicated ultimately in a variety of educational 
contexts. To some extent this requirement can be met by testing a particular practice in 
different programs, or with different populations of students within a single program, in 
the long run, however, this is not sufficient; for until it can be shown that a particular 
practice is successful in a number of institutions, it is not likely that it will have a great 
deal of acceptance in or utility to' teacher education at large. 

In carrying out inter-institutional studies on alternative practices, it will be necessary, 
of course, to use the same kind of dependent measures, to control for the same sources 
of variation, and to collect the same kind of data on costs and benefits as collected in 
intra-institutional studies. 
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. PART IV. BASIC RESEARCH STUDIES 

The logic behind and the imTiediate payoff from both policy- and practice-oriented 
studies are apparent to most teaeher educators. This is not the case for basic research studies. 
In fact, there is often open hostility on the part of both educators and teacher educators 
toward research activities labeled as basic. While understandable, this is an unfortunate 
circumstance, for like it or not the kind of research activities that typically get classified 
as basic are at the center of how mejnbers of. a particular profession think, work, and extend 
the knowledge base of their profession. 

\ 

Notes on Terminology 

White the distinction between basic and applied research.has never been particulaily^ 
clear (Cohen, 1948; National Science foundation, 1960; Brooks, 1967), the distinction^ 
has been maintained for purposes of the present paper. As u^d here the concept of basic 
research is essentially a catch-all category to describe research activities that cannot be 
classified as either policy- or practice-oriented (applied) studies. ^Typically kich studies 
deal with matters that have little direct utility to the educational practitioner. Most commonly 
they deal with variables affecting instruction, rather than with full-blown features or aspects- 
of an instructional program. Because of this, they tend to be linked more^ closely to the 
development and testing of instruction-related theory than they aref to the development 
and testing of instructional programs and procedures. 

As a consequence, educational practitioners tend to find the results of basic^esearch to 
be of little direct utility and, as a by-product, of little interest; persons concerned with the 
development of instructional theory, however, or person^ attempting to carry out practice- 
oriented research, find the results of basic studies to be essential to their work. 

The distinguishing features of policy-oriented studies, practice-oriented studies and basg: 
research studies, as these are treated in the present document, are summarized^n Table 4. 

Notes on CBTE Programs As Contexts For Basic 
Research In Education And Teacher Education 

Historically research in education and teacher education has been disappointing (Gage, 
I 1963a; Smith, 1972; Travers, 1973). A host of explanations have been offered for this 
fact, including the argument tha^the world cf education is simply too complex to yield 
to the strategies of science. \ln the judgment of the committee, however, two interdependent 
factors offer a more plausabla explanation: 

the failure to devise experiments that meet the requirements of 
external validity (see pp. 11 to 13); and 



^ Survey research is another class of research activity frequently engaged in by educators, 
put because of its relative simplicity it has not been dealt with. Obviously, surveys can 
produce information that is of considerable use to educational practitioners, particularly 
|f they supplement information gained through policy* and practice-oriented studies. 

J- 
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the failure to devise measures of dependent or outcome variables 
that are conceptually consistent wUh the learning outcomes in- 
s tended from a treatment condition, and at the same time 
feasible to apply and meaningful to those who are to use them 
or benefit from their use. 



The rationale for this point of view is straightforward. No matter how powerful a research 
design, a weak or unimportant treatment condition will never give rise to research results 
of practical significance (the external validity problem). But what is nioie important, 
even when a strong or important treatment condition is combined with a powerful design, 
research results of practical significance will never be obtained unless the measure of effect 
^"1s\trong (the dependent or outcome measure problem). 

Table 4. Features that distinguish policy-oriented, practice- 
oriented and basic research studies in teacher education 



Type of 
Study 



POLICY- 
ORIENTED 
STUDIES 



Experimental 
or 

Treatment 
Variables 



Teacher Educa- 
tion programs 
or elements of 
such programs 



Dependent 
or 

Outcome 
Variables 



Short- and long- 
term measures 
of success as 
a teacher 



Control Over 

Unwantecj 
Sources Of 
Variation 



Loose 



^ Collection 
of 

Cost-Benefit 
Data 

Yes 



PRACTICE- 
ORIEIsfTED 
STUDIES 



BASIC 

RESEARCH 

STUDIES 



Instructional 
units or se- 
quences (mod- 
ules) within ' 
programs that 
are designed 
to bring about 
specified learn- 
ing outcomes 

Practices, 
procedures or 
variables 
assumed to be 
related to 
learning and 
instruction 



Intended and 
unintended 
effects of the 
instructional 
unit being 
tested 



Moderate 



Yes 



Performance on 
a conceptually 
relevant measure 
of learning 
effects 



/ 



Tight 



No 
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One of the most hopeful features of the competency based-education and teacher education 
movements is that, as envisioned, they should do much to overconne these two problems. 
If carried to successful completion, they should provide better defined and more powerful 
treatment conditions and better defined and more powerful measures of learning outcomes 
in teachers and pupils. If tfiese contributions of CBE and CBTE are of the kind and quality 
anticipated, and if the research community recognizes them as such and takes advantage 
of their availability, basic research- as well policy*oriented and practice-oriented research- 
in education and teacher education should profit immensely. 

Two additional conditions must be met, however, if competency-based education and 
teacher education programs are to become functional contexts for basic research. First, 
as implied above, the measures emj^loyed in the assessment of desired learning outcomes in 
pupils and teachers must be of a quality that permtte their use in research. That is, they must 
be vaMd, reliable and sensitive. Second, experimental designs must be employed with sufficient 
rigor that causality can be attributed to the experimental or treatment Variables being In- 
vestigated. Both of these conditions are above'and beyond the requirements of normal 
program operation, either in schools or^n teacher education institutions, but there is 
reason to believe that both can be achieved if introduced with care and foresight. When these 
conditions are met, much is to be gained, for basic research can be carried out as an adjunct 
to the normal operation of 'educational programs at little added cost! 

While it is possible to combine'basic research with program operation by m*^ting these 
two conditions, it needs to be pointed out that considerable risk is involved in attempting 
such a venture. Hi^ quality measures, for example, are of ten difficult and costly to obtain. 
Also, requiring that program operations meet the constraints of experimental design almost 
always creates a cumbersomeness and rigidity that frustrates program managers and participants. 
Heretofore, efforts to design data collection systems that support both program operation 
and basic research have tended to end in the design of research programs instead of operational 
programs that have good data. When tfiis has occurred there has been a nearly iiniversal 
reaction on the part of program managers and participants: throw the researchers out! 
(Parlett and Hamilton, 1972). , 

Recognizing this pitfall, it should still be possible to design data generation systems that 
will support both program operation and basic research. When this is the case, the best 
possible context for basic research existe: it can be carried out at low cost and it has a good 
chance of meeting the requirements of external validity that are not met in most educational 
experiments. 

Four Categories Of Basic Research Studies 
In Education And Teacher Education 
That Need Particular Attention 

. No effort will be made in the present paper to deal with the full range of research activities 
that are typically labeled basic. Instead, four of the most representative of basic research 
activities, and in the committee's judgment four of the most critically needed research * 
activities for the long-term betterment of education and teacher education, have f^een 
selected for discussion. These have been labeled: 

. construct delineation studies; 
. instrumentation studies; 
. principle identification studies; and 
. model testing studies. 
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While the language used to label these four broad categories of research activity mav be 
unfamiliar to some, the research activities to which they apply are commonplace in the 
physical, biological and behavioral sciences, and are widespread in most knowledge-bag^d 
enterprise of man, for they constitute the means by which the basic concepts, principles 
and methodologies of a discipline or profession ar^ fashioned. 

Unfortunately, they are not commonplace research activities in education. It is the view 
of the CBE Centers research committee, however, that they must become so if the profession 
of education ever is to do well what it has been asked to do. 

Before proceeding to discuss these various categories of research activity, two comments 
need to be made about the interdependence of basic research in education and teacher 
education. The first has to do with the need to distinguish sharply between learning and 
teaching or instruction. As strange as it may seem, this is a distinction that largely has 
beeq ignored by educational and psychological researchers in the past (Gaga, 1963b), 
but one that in recent years has begun to bear fruit {Hosford, 1973; Nuthall and Snook, 
1973; McNeil and Popham, 1973). As used in the present paper, theories of learning deal 
with how an individual takes in, stores, transforms and utilizes information; theories of 
teaching or instruction deal with how an individual influences tha^ process. In drawing this 
distinction elsewhere, Schalock has pointed out that 

In a sense tfie distinction is arbritrary, for the end point of both is learning. 
In another sense, however, it is not, for the focus of one is upon the process 
of learning and the other upon the conditions of learning. By forcing the 
distinction, and then attending systematically to the conditi6ns of 
learning (instruction), issues that tend to be obscured when focusing 
upon learning, come into full view; for example, the dependence of 
instructional decisions upon educational objectives and learner 
characteristics. In their pursuit of laws governing learning, experimental 
psychologists have not attended systematically to either of these classes 
of information . . . The assumption underlying the pr^ent effort is 
that by high-lighting the instructional process, and by atten^ng to it 
both conceptually and empirically, it will be possible in time to 
develop a productive science of instruction which, in turn, will permit 
an effective and efficient technology of instruction. 1(1972, p. 39) 

. The position being taken in the present paper is that educators and teacher educators 
should focus their basic research efforts on instruction and let psychologists continue to 
focus their efforts <Jn learning. 

The second comment grows from the first: that is, when tested concepts and principles 
pertaining to instruction emerge from basic research activities, they are equally applicable 
to teachers and teacher educators. Teachers need access lo ever more powerful concepts 
and principles to guide their instructional activities with pupils. Teacher educators need 
access to the same information, but for two reasons: it is information that needs to be 
conveyed to prospective or experienced teachers so that they may use it in future, and it 
is information that needs to be taken into account in designing instructional activities when 
teaching prospective or experienced teachers. From this point of view the design of basic 
research studies on instruction (as distinct from learning) should not vary greatly when 
carried out by educators or teacher educators. The subjects taking part in a study will 
probably vary (e.g., college as opposed to elementary school ^itudents), and as a con- 
sequence, treatment conditions and measures will vary, but the fundamental nature and 
function of such studies will be the same, namely, the identification or sharpening of concep 
principles, models and methods that can be brought to the process of instruction wherever 
and whenever it occurs. 



Construct Delineation Studies^ 
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An essential feature of any discipline or profession is the development, extension and 
refinement of its constructs, for it is through its constructs that it gains its power. 
Conceptualization (the building of constructs) is a constant cyclical, data-dependent 
process wherein new data (observations) give rise to new constructs and neJ Constructs 
give rise to new data. The cycle does not begin at a particular place, nor end; it is ever 
present and so long as man inquires, it will forever be present. 

The point that is critical here is that constructs do not just happen or do noX first exist, 
They are man-made and they ai;e constantly evolving. For ages, man disregarded certain 
objects or their effects because he did not know of them or their behavior. He did not 
notice, for example, ultraviolet radiation nor the fsot that quartz reacted differentlv/frd) 
glass to ultraviolet li^t. Nor did he notice electrical currents in the brain, or unconscious 
motivation, or that some people can taste certain things and others cannot. We novy have 
such constructs, and they have lead to an appreciable store of knowledge. We do not have 
them in the same form as they were conceived initially, hdwever. Atomic structure, circa^ 
1974,. is not atomic structure circa 1938. Neither is intelligence nor motivation Kor learning. 
Constructs come and go, may be powerful or weak, but always they change. Moreojjer^ 
whatever their form, they dictate what is to be observed and measured. 

As indicated previously, constructs that are central ta instruction (in contrast to learning) 
have only begun to be specified and systematically researched. With the exception of Bruner 

. (1966), and more recently Hosford (1973) and Dunkin and Biddle (1974), no theories or 
models of instruction (in contrast to theories or models of learning) have been seriously 
put forth to be tested. As a consequence, construct delineation studies in education and 

^ teacher education have a relatively weak conceptual and empirical base from which to 
begih.^ ' ^ i 

Ideally, construct delineation studies are guided by a reasonably well-specified conceptual 

^amework. Such a framework is u^ed both as a source of constructs and as a guide to how 
the various constructs being tested' relate to one another. Without wishing to become 
embroiled in the paradigm-model-theory debate (Brodbeck, 1963; Gage, 1963b; Snow, 1973), 
an illustration of such a framework that applies to instruction is presented as Figure 1.^^ 



'The content of this section of the paper draws heavily from two previous publications by 
the author, a chapter on Measurement in The National Research Training Institute Ma nual, 
Monmouth, Oregon: Teaching Research, A Division of the bregon State System of Higlier 
Education, (1969) and a chapt6ron Learner Outcomes, Learning Processes and the Conditions 
of Learning in The Contribut io n of the Behaviora l Sciences to Instructional Technology: 
Th e Cognitive Domain ( A Resource Book for Media Specialists), Washington, D. C: Gryphon 
House, 1972. 

^Constructs are concepts which have the added meaning of being deliberately or consciously 
^created for a special scientific purpose. Intelligence is a case in point. 

^ft could be argued that persons like Skinner (1954, 1968) and Gagne' (1965, 1970), 
who are identified primarily as psychologists concerned with learning, have in fact put forth- 
theories of instruction. In these two instances, this is probably the case. It is not the case, 
however, for most psychologists working in the area of human learning. 

^ Whether the framework is a model, a paradigm, or a first cut at a C or D Theory is 
unclear. What is clear are the directional implications of the framework for research on 

instruction. Since these directional iniplications are immodestly seen as defining the 

legitimate problems and methods of a research field for succeeding generations of practi- 
tioners (Kuh, 1962, p. 10), the framework could, with equal immodesty, be referred to 
as a paradigm. v * 
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Learning 



Figure 1. l^e factors that need to be consider^ in establishing effective conditions 
ii instruction at a particular point in tipie (the circles on the arrowed lines 
represent learner behavior and the squiggles represent the filtering effect 
of teacher characteristicsK)n the perception of learner behavior and the 
other factors affecting learning). 

Three commen<fe need to be made about the paradigm. First, the paradigm can be described 
best as a context dependent paradigm, for it is based o^i the assumption that, for instruction 
to be effective, what a)teacher does must always be adjusted to the nature of the learning 
outcome(s) desired, to the nature of the learner(s) being taught, and to the nature of the 
setting within which learning-teaching is occurring-as well as whatever is known about how 
learning occurs. As such., effective teaching is seen as representing.an articulation of a 
remarkable number of /Variables, especially when a wide variety of learning outcomes are 
being pursued by a wide variety of learners under a wide variety of learning conditions. 
While this is not inconsistent with how instruction is viewed^ generally, it is inconsistent 
with how most research on instruction has been done. 

Second, the parailigm has sjtrong directional implications for research on instruction. It 
specifies the maj^rclasses of variables to be attended to in such research, and it specifies 
that these variables be treated in designs that accommodate them as interdependent or 
contextually dependent. • 

Finally, it lends perspective to the anxiety which many educators feel about the continued 
emphasis in CBTE on t eacher behaviors , and the continued press to carry out research that ' 
attempts to link teacher behavior to pupil outcomes (see articles by Rosner and Kay, 
McDonald, and Flanders in the January, 1974 issue of the Phi Delta Kappan as examples 
of the continued press for such research). Within the proposed paradigm, teacher behavtor 
may he treated as either a dependent or an independent variable; when it is treated as an 
independent variable it must be done so within a design that links it to student characteristics, 
setting characteristics, class or learning outcome pursued, and the learning processes involved 
in the mastery of such outcomes. i 
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Within such a framework, the continued search for simple correlations between teacher 
behaviors and learhing outcomes in children does not carry much appeal. Nor does it carry 
much hope, considering the near infinite array of permutations possible bc^tween particular 
^ behaviors, particular learnings, particular learning outcomes, particular teachers, etc. The 
conclusions re^ed by Rosenshine and Furst(1971'), therefore, should not be surprising^ 
Nor should the kind of criticism t^at Maxwell h^s recently leveled at persons r^ponsible 
for the design of CBTE programs who continue to define teacher competency in terms of 
specific teacher behaviors: 

« We don't have a list of the competencies of the successful teacher 
for the Simple reason that teaching is an art-not a science., Qehavior 
' that is a valuable asset to a given teacher with a.certain personality in 
. many (but not all) situations, insofar as most (but not all) of h^s 
pupils are concerned, may well go over like a lead balloon (to most 
students) if affected by some^other teacher with a different personality. 
We' can't even say that a teaclier should love his students, since 
many teachers that we and the students consider successful exhibit 
no behavior'(measurable or otherwise) that would lead one to this 
conclusion. 

♦ 

The teacher/student relationship is one characterized by heterogeneity 
on both sides of the relationship. The art lie^ in knowing, or sensing, 
What^parficular stimulus or behavior is best for me as an individual 9 
' teacher to reach most effectively a particular student or group . * ^ 

of students in a given set of circumstances. To assert that the 
competent teacher will demonstrate his concern for persons in the ' 
' lower socio-economic groups by voluntarily spending at least two 
^ hours per week working in a social agency is absurd, no matter how 
highly we value such concern or approve of such work. We can make 
no such simple statement about the conr^peteny teacher. (19^4>{^10) 

In order to carry out research on instruction that meets the requirements of the paradigm 
* outlined above, i^ is necessary to^ define, establish the parameters of, and make operational 
the major variables contained within it. The research and development involved in this 
process is perhaps^e most basic of all activities that goes on in any science. It is a highly 
conceptual activity; it invoivas basic methodological workjp that constructs musj: carry 
operational definitions and be' subject to measurement irrorder to be incorporated into a 
rese^ch program; and it involves a major empirical effort irf order to determine whether 
the constructs identified are suff iciently^^owerful to warrant inclusion in research on the 
paradigm proper. In its moVe advanced stages it is also likely to involve theory testing, 
since any set of constructs take thcrir definition within a theoretical^ system of one kind pr 
another. * • ^ 

For all these reasons it is proposed that construct identification studies tje considered 
\as a necessary part of an;^ basic research program on instruction, and that it be seen a^ 
paralleling or preceeding the.o^er categories of basic research on instruction that are being 
proposed. 

The design of construct identification and delineation studies assumes two basic forms. 
The first is a classic, ^ngie variable or comparative research design in which the purpose is 
to determine whether a particular construct has any identifiable impact upon learning 
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outcomes In children, or if it has any likelihood of such impact even though tfierejs no 
empirical evidence to that effect. J^esearch of this kind is always guided by the paradigm' - 
that reflects the particular view? of instruction that is being res^rched, for example, an 
inquiry or a precision approach t6 instructiqn.^The specific purpose of such research is to 
•define within the broad classes of variables identified within/igure 1, specific variables 
that are promising for inclusion in the next level of research, that is, research that seeks to 

establish laws or principles. ' ■ ■ . j • 

A second research design thatjs a necessary feature of construct identificatioiT and ^ \ 

delineation studies is a testingspf methodology design. When new constructs are 'dentif.ed^ 
or when existing constructs are refined, a set of measurement o,^rations have to be deyelopfed 
jn order to test the power of the constructs. Since the results of any research study are y 
good only as thetneasures of the constructs employed within it, the development of itrdng 
measures for all constructs to be investigated becomes a critically important activity. ~ 
^Central in this activity are comparative studies of the power or effecti veneg_of_alternatiyg. 
approaches to measuring a particular construct . Because of^the importance ai^ complexity 
of this kind of research, and because it borders upoh and at times becomes syiibnymous , 
with the reliability.and validity studies that must be carried out as a part of instrumentation, 
it is treated for purposes of the present paper as a separate category of research. 

In closing W discussion of construct identification-delineation studies, four. obssrvations 
seem appropriate. First, studies.of this kind do not need to start from scratch. Large 
literatures exist with respect to at least four of the five clusters of variables identified ip 
Figure 2, and a literature is beginning to emerge in relation to' the fifth. Second, resear^i 
of this kind has not and need not be carried out only by education&l researchers. Biologists, 
psychologists, anthropologists, and sociologists are all involved in the identification and ^ 
delineation of constructs that contribute to the conceptual stnfcture called for by the • 
paradigm. ^ Third, the process of construct identification and delineation is laborious, complex 
and" time consuming. It is also never-ending, for implicit in the philcsop»iy.of science is 
the assumption that constructs will never cease to evolve nor will they ever find their 
absolute definition. In this context it is probably safe to say that the professional life-times 
of dozens of resea.chc-s will be needed on each of the classes of variables identified in 
Figure 2 before constr cts will surface that are sufficiently powerful to permit research in 
education to proceed with the hopefulness of difference-making that research carries, in 
the basic sciences. 

Finally, the Same reasons Mat make CBTE contexts so desirable for carrying out practice- 
oriented studies are the sam^? reasons that make them so attractive for construct identification, 
delineation studies. It is a stable, continuously available research context; many of the data 
needed for such research are available as a consequence of normal program .operation, 
thus making it a low-cost resea;ch context; and the variables being investigated are the real-life 
variables with which teachf • educators and educators must deal. Stabilrty, accessibility, 
low-cost, and the likelihood of being able to overcome the problem of the externa! validity 
of experiments constitute much of the valuejto be gained. . 

instrumentation Studies 

As indicated above, a construct takes its meaning through the operations used in its 
measurement, as a consequence, the development activities involved in creating and refining 
measures of constructs is what is ref^^^ to here as instrumentation studies. 
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The development Osgood measurin ^^struments is a comf^x and demanding process, 
and one that requires the application re. ;tively unique, research procedures" The various ^ 
forms of item analysis, reliability testmg and validity testing in relation to norm-referenced 
measures is a case In point (Thorndike, 1971; Campbell and Fiske, 1959; Cronback and 
Meehl, 1955). ^ 

Still different research procedures are needed when developing crit^ion referenced 
jneasures, observation?) measures, and situational-response measures. It is beyond the scope 
of the present pJaper to deal with these various procedures, but the reader who wishes to 
engage seriously m construct delineation r^earch, or forany obier reason needs to develop 
a particular measure or set of mej^jsures, is encouraged to refer to such classic texts as those 
by Lindzey (1954) and Jahoda, Duetsch and Cook (1951) as a point of departure. Schalock 
{t969) has s^mmari^ed the advantages and disadvantages that typically accompany various 
approaches to measurement in education and the behavipral sciences, ^nd the kinds of 
evidence needed ,^bgat eqchrkind of measure in order to have confidence in its use. 

Central to the design of instrumentation studies is the matter of criterion. On what basis 
is the decision to be made that one approach to measurement Is superior to another ior a 
particular variable or constnict? The correlation of one measure v.ith another that is known 
to be a valid measure of ^e construct unfler consideration {the criterion used in concurrent 
validity Wdi^l iSuart inappropriate strategy,' for it provides no^nforgiation as to which of 
the two measures isin fact the more powerful. In mok cases, instrumentation research • 
myst move to the arena of prediction in order to obtain data on the relative power of one 
measure to another. As tortuous and<:onvoluted as predictive evidence often ^omes 
(Schalock, 1969), it is the only evidence that can be locAced to Wlith confidence imtests 
of the comijjfugtive powef of alternative measures. Oth^ things being equal] the measure 
that predicisfwith qiost accuracy'or power hnaist be viewed as the better measure. 
. One of the dilemmas faced by researchers in education and teacher education is the time 
and ehergy riequired to create sound measures. It is not uijcommon, for example, to spend 
as rpuch time in preparing a measu?^ use in a resemsh study a? is spent in carrying out 
the research in which lt is used. In fac^, it is not uncommon to devote a lifetime ofr?fesearch 
to just the development of a measure or set of measures. » 

While the time and energy required for the development of sound'measures may be dis- 
concerting to some, it should not cause researchers to circumvent this most inportant of 
all activities. Informatipn coming from a,substantive research effort is only as good^iis 
the measures used in the collection of that information. The garbage in-garhage out 
dictum cannot be taken lightly. To help eliminate the waste that has characterized so much 
of educational research, future generations of researchers are encouraged to attend to problems 
of instrumentation as carefully as past generations have attended to problems of design and 
analysis. . ^ . L 

Principle Identification Strides 
. ' i 
^ tWhen construct delineation and methodological research hjsrprogressed to the point 

*where reasonable confidence can be placed in one or mofe variab)es within the various 

classes of Variables spfecified in F^ure 2, research on the identification of instructional 

princi^es can. begin. As used -in the pr^ntpapeK a principle of instruction isan empirically 

esta blished-relationship between a particiHar set of instructional conditions and a particular 

class of learning outcome for learners who have a particular set of learning-related characterist ics 

and are working und er a particular set of learning conditions. The power of such principles \ 

rests in the guidance theyVrovide for instructional decision making by teachers ind the 

designers of instructional materials ar 1 programs. If strong principles (clearly demonstrated. 
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empirical relationships of the kind referred to above) were establiiihed,. teachers a.^d the 
designers of instructional materials woyld have a set of guidelines that could be rehed upon 
in creating the conditions needed to bring about the desired learnmg outcomes. Until 
such empirical relationships are esta^jished, on-line instruction, as well as the design of 
Insiructional materials, must of necessity be an interactive process involving oest guesses 
and successive approximations. . • • • i 

In some respects the design of research that aims toward the identification of principles 
of instruction is more somplex than that aimed at the identification of constructe and the . 
developnBnt of good measures, but in other respects it is less so. On the one hand, princp^- 
related research requires the use of designs that will accommodate a large| number of sources 
of variation in the course of a single study than does construct related research. On the other 
hand the criterion problem is much less troublesome. The criterion pf progress in relation 
to desired learning outcomes is straightforward and unambiguous; the criterion of predictive ^ 
utility is anything but. ^ 

Be this as it may there are designs and methods of analysis that can accommodate the 
complexity required by principle-related research. Prototypic in this regard are the designs « 
and analyses used in aptitude-treatment interaction studies (Bracht, 1970). (Cronbach and 

Snow, 1969). ^ ^ . . . 

< As in the tase of construct related studies, a number of comments need to be made before 
leaving the discussion of stQdies aimed at establishing instructional principles. First, while 
studies of this kind do not need to start from scratch, they do not have the conceptual 
and empirical base enjoyed by constro^t-related studies. Aptitude-treatment .nteraction 
studies are prototypic. but they need t& accommodate the additional variables identified 
in Figure 1. Second, research of this kind will probably be undertaken onbL by educational 
researchers. While biologists, psychplogists, sociologists and anthropologists searcli for and 
. work with many of the same constructs that need to be involved in instructional research, 
they will rarely search for instructional principles of the kind considered here. Third, the 
process of establishing instructional principles is just as laborious, complex and time- 
consuming as the process of delineating constructs and developing methodology. It is also 
as neverending. In part this is because of the interdependence of construct and principle- 
related studies: as better cohstructs are established, better principle related research can be 
undertaken, and as better principles of instruction emerge, sharper constructs and finer 
measures can be developed. In part, however, the difficulty is because of the implicit 
assumption in the philosophy ef science that principles once established will forever be 

refined. , , . ^ . ^ n 

Finally the reasons that make a CBTE context a particularly attractive-context for all 
of the other kinds of research' that have been discussed are the same reasons tl^at make it 
a particularly attractfve context within which to pursue research leading to th^establishment 
of instructional principles. It is a stable, continuously available context in whibh the cost 
of carrying out research is low and the fidelity (external validity) of the variables is high. 
Given the likelihood of a large number of pilot or exploratory studies being performed 
(the frequency of false leads and wrong predictions will undoubtedly be high in the beginning) 
artd given the requirement of a large number of replications to establish the confidence 
levels needed if practitioners ai. to rely upon the emerging principles as guides to instruction 
and inimlctionai development, .a resenrch context that has CBTE lik^ properties would seem 
to be a necessary condition for the condact of prmdiple-related research. Whether ongoing 
CBTE programs can be found that wil! tolerate the demands placed upon them such 
research, and at the same timej)ossess staff -vith the competence to carry out such research, 
is an open question. Until such contexts are available, however, research that makes an 
appreciable diffei'ence in instructional design and, practice is not likely to dccur. 

/ 
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ModeJ^ Testing Stjdies 

Another research activity that ijTcommonplace in the physical, biological and social 
sciences, but relatively rare in edi/cation and teacher education, is theory or model testing 
research. Typically this kind of research involves the testing of hypotheses derived from a 
well-developed conceptual framework, with the results of the test being used to validate 
w invalidate, refine or extend the conceptual frame. To the extent that ainodel or theory 
is useful, this is perhaps the most powerful kind of , research activity in which to engage,'for 
its long-term aim is the development of a framework that integrates a large number of concepts 
and principles in a way that makes prediction possible. ^ 

A number of educational philosophers and researchers have pressed for the initiation of 
model testing research in education (Brodbeck, 1959, 1963; Gage, 1963), but as yet few 
such studies.have been undertaken. 

One of the chief reasons for the lack of model testing studies in teacher education is the 
lack of well-articulated models to be tested (Snfow, 1973; Nuthall and Snook, 1973). Another 
is that when a mo4el of one kind or another has been tested, results generally have been 
disappointing. A case in point is the work of David Ryans (1^0). His was a model of 
teacher effectiveness that spelled out a set of traits assumed to be needed for successful 
classroom teaching. The results of Ryans' research was on the whole disappointing, and little 
has been done with his model since. 

This kind of history does not mean, however, that model testing studies are necessarily 
doomed, interest in model building and testing^seems to be on the upswing. A good example 
of this trend is the sociologically and psychologically based model of teacher effectiveness 
advanced by William Spady of NIE (1973, 1974). fjis model seems to be more powerful 
conceptually than Ryans' model, andin many respects more subject to empirical test. He 
proposes four characteristics that a teacher must possess to be effective: (a) have something of 
substance and interest to say; (b) be<:apable of saying it clearly and accurately; (c) be capable 
of saying it in a stimulating and exciting fashion; and (d) base this communication directly 
on a concern for the personal welfare of each student. (1973, p. 26). He then goes, on to 
say 

. . . these four conditions or attributes can conveniently be grouped in 
pairs: the first two, referring to the teacher's subject matter expertise 
and pedagogical skills, underlie a general expertise dimension; the 
third and fourth define a charismatic personality dimension con- 
sisting of an exciting and inspiring, yet empathic, manner of , 
relating to others and their personal needs. 

By-dividing the four dimensions into two categories, high and low, and then charting the 
two clusters of categories into a sixteen^ell matrix, Spady is able to lay out, in a highly « 
schematized fashion, the attributes that he feels are needed to effect teacher legitimacy and 
effectiveness. His sixteen-cell table appears as Figure 2^ He would predict that teachers* 
falling in cell 1 would be most successful and those falling in cell 16 least successful. 
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Figure 2: A classification scheme for role attributes assumed to 
be needed to maximize teacher effectiveness. 

The reason for presentfhg the Spady model in this much detail is to illustrate for form and 
content that a model might take that is appropriate to teacher education, and to show how, 
such a model might be tested. It would be possible, for example, to assess prospective or 
inexperienced xaachers on each of the four dimensions specified in the model, classify them 
according to one of the sixteen cell positions, and then test the effectiveness of teachers . 
that are classified in the various cells. Such research assumes, of course, the existence of 
good measures for each of the four dimensions, and good measures of teaching effectiveness. 
Given these two assumptions; however, and the assumption that teachers can be found to 
take part in the study- assumptions tnat are reasonably realistic within the context of operational 
CBTE programs -such a study should be able to be carried out. / 
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It has been argued (see pp. 3-4) that CBTE needs to be the focus of documentary 
or case stiidles as well as basic and applied research studies. The rationale for the agreement 
is straightforwarri: (a) competency-based programs are a great deal more complex in their 
structure and organisation than traditional programs; (b) they require for their development 
and implementation a level of assistance beyond that required to implement programs of 
a traditional kind; and (c) an extremely useful way to provide such assistance, indeed 
perhaps the only way, i^rough detailed documentation of th? development and operation 
of existing CBTE prograr^ 

It is the opinion of theCBE Centers' research committee that knowledge of the development 
and implementation process in CBTE represents as much a knowledge gap as the various 
other gaps that have been referred to in earlier sections of the paper. 

At least three kinds of case studies are needed. One should focus on over-all program 
development and operation; another on aspects of CBTE programs that are particularly 
complex to develop and operate, or that have been particularly tardy in their development; 
and stiil another on the diffusion of program practices within an' institution, or to other 
institutions within a state or region. Examples of the first type of study include the AACTE 
Monographs on Weber State (Burke, 1^74) and Oregon College of Education (forthcoming), 
and the volume by Dickson, et al on the CBTE program at the University of Toledo (1973). 
Examples of the second include the DeVault, et al report on module development (1973) 
and the Schalock, et al. report on the deyelopment of the OCE-TR system for assessing 
competence in teaching (1974). An ex^pte of the third type of study appears as Appendix A. 

IdeatTy, attention would be directed within each kind of documentation study to both 
developmental and operational issues, and within both of these to the critical decision points 
encou ntered, th e decision alternatives considered, the decisions made, the consequences 
of the decisions made, and, to the extent possible, the likelihood of the consequences of 
alternative decisions considered. ♦ ^ 

Collectively, these various approaches to documentation would give the potential developer 
of CBTE programs access to knowledge, which only experience can provide. They would 
give access, for example, to practices and procedures used to develop CBTE programs or 
tu share programs with others once they have been developed. They would also provide a 
good sense of the effectiveness of such practices and procedures, at least as they have been 
applied within the constraints of one reaMife, ongoing operational program. In short, a 
carefully selected set of documentation studies would provide the kind of information 
needed about program development, operation and diffusion that is extremely difficult to 
obtain in any other way, and it is information that must be available if the principles of 
CBTE are ever to be adopted widely. 

On the basis of experience in preparing carefuHy documented case studies of ongoing 
research and development programs (Schalock, et al , 1972), it is essential that the preparation 
of CBTE case studies be undertaken with as much planning and forethought, as much pro* 
fessional expertise, and as large a resource base as any of the applied research studies that 
have been qalled for. It is unclear, however, how test to actually carry out sugh studies. 
(>ie procedure would be to contract with an agency to carry out all documentaries. This » 
would involve the preparation of staff, the collection of data, the provision of case study 
reports, etc. The advantages of such a procedure, as compared to a series of independently 
initiated studies, are efficiency, comparability of reporting formats, and reasonably good 
'assurance of quality. The disadvantages are the lack of first-hand familiarity with the data - 
to be reported and the depencence on the recall of others to provide such data. 
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An alternative approach would be to provide only for the central coordination and management 
of the documentation effort at the federal level, for example, establish specifications as to 
substance, format, etc.. and use trained staff from the institutions whose programs are to 
be reported as scribes or reporters of the development and implementation process as it 

is occurring. i ' 

Either procedure would require a considerable funding base, a great deal of preparatory 
and design work, access to expertise in case study preparation, and a well-designed management 
system to insure optimum quality at minimum costs. These are all difficult conditions to ; 
cohie by. and there is danger that without a clear recognition of the complexities involved ; 
in meeting them an effort to prepare the kind of case studies cafled'fpr would be disastrously 
undeHunded and understaffed. , ' . u • 

A by-product of the documentation studies outlines, or perhaps a companion to them, is a 
series of case studies that document the<Ievelopment and operation of CBTE programs that 
serve as contexts for reseatch (for a brief description of two such contexts see PART VI 
of the paper). While relatively few CBTE programs will meex the criteria needed to function 
as research centers, it would seem to be important to include them in the over-all documentation 
effort. Given the promise that such centers hold for educational research, and given the 
nature of the relationships that must exist between instruction and research if a program is 
to serve as a functional research context, it would seem that dotJumentaries of this kind 
vyould be of particular interest to an agency like NIE. Since the creation of CBTE centers 
for research may be to education what the creation of laboratories has been to the physical 
sciences, agencies like Nl E should understand all they possibly can about how such centers 
function. ' 



\ 
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PART VI. ORGANIZING TEACHER PREPARATION 
PROGRAMS AS CONTEXTS FOR RESEARCH 

Throughout the paper an emphasis has been given to the hopefulness of competency- 
based education and teacher education programs as contexts for research. If properly 
organized, and if measures of competence are of sufficient quality, they represent contexts 
wherein research can be carried out at low cost and high external as welt as internal validity. 
This is a condition \'hat has never existed in education or teacher education and, if established, 
represents for the fiist time the possibility of the profession's moving to an empirically 
based mode of operation. 

it has also been emphasized throughout the paper, however, that attempting to combine 
research and education functions is a complex and often risky venture. Competency 
* measures of a quality that permits them to be used in research, for example, are costly and 
difficult to obtain. Controlling for sources of unwanted variation through use of experimental 
and control groups places constraints upon program operators that are often frustrating 
if^not tolerable. As pointed out earlier (see p. 13), at least five conditions seem to be 
needed if an ongoing education program is to serve as an ongoing research context: 

Persons responsible for the management and operation of the program 
must be in rjj ned toward experimentation . Commitment to empiricism 
and the desire to know must be dominant features of the context. 
Research must be viewed as an integral part of program operation^ and 
as such, viewed as a continuous, necessary and desirable part of the 
program. v 

Persons respo nsible for the management and operation of the education 
program must view it as subject to continuous change, and view as a 
major data source for its change a systematically di^igned program 
of research on its effectiveness. When viewed in this way, research 
can have both the immediate and applied value that it needs in 
order to be supported by those responsible for program operation. 

Data of a qualit y that will support trustworthy research must be col- 
l ected as a n orma l part of program operation. Accurate, reliable 
descriptions of program operations must be provided, and accurate 
reliable measures of learning outcomes must be recorded as a matter , 
of course. 

Sophis ticated data management storage, retrieval and display capabiliti es 
mu st be available . Data to be used for research, program operation and 
program adaptation purposes must be routinely stored on computers 
^ and routinely retrieved in formats that support program-related 
decision making and research. 

There must be a n advi sory structure th at insure s that the.research 
pursued has value to persons i n the program as well as to the 
prof essio n at large. 
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Conte)<tually vdlid experimental research lays heavy demands on ongoing educational 
programs, and unless the context within which a program rests is special, in many ways 
the demands of research simply cannot be met. 

Since fully operational CBTE programs are only now coming into existence, it is 
obviously premature to look to such prbgrams for examples that are functioning as research 
contexts. Energies and resources beyond those required for program operation have been 
directed largely to program development. And they continue to be. Moreover, even if 
ener«}y and resources were available for research, few programs have developed measures 
of competence of a quality that permits tiiem to be used for purposes of research. 

Be this as it may, two CBE Centers have begun to direct attention to the research function: 
the OCT-TR Center in Monmouth, Oregon and the Center at the University of Toledo. 
Though incomplete in their developntent, these two Centers will be described in the pages 
that follow as prototypic of the kinds of contexts envisioned ultimately for a reasonable 
number of CBE programs.^ ^ 

Tho CBE Center At Oregon College Of Education 
As A Context For Research 

The Elementary Teacher Education Program at OCE meets the recommendations out- 
lined above in that it has the following characteristics : 

The public commitment of staff and administrators to the research function 
* the program is to serve; 

^ - ^ the public commitment of staff and administrators to the program being subject 
to continuous change, and for the direction of change to depend to a large extent 
upon the results of research on program effectiveness; 

The systematic collection of data for use in research on (a) the characteristics 
of the ETE program (curriculum, organization); (b) the characteristics 
of students in the program (traits, background experiences); (c) the 
knowledge, skill and demonstrated teaching competence of students in the 
program; (d) the behavior and learning outcomes of pupils taught by students in 
the program; and (e) the characteristics of the settings in which teaching occurs; 

The maintenance of quality in all measures taken in the program through 
continuous quality assurance studies; 

A computer-based data management system that supports all research and 
quality assurance studies; 



An advisory structure that injures that the research pursued in the prdgram 
has value to the prof essiorfat large as well as to those in the program, and 
at the same time reflects a level of quality that sets a standard for research 
in the profession; and ^ ^ \ 




^ ^ Other CBE Centers are engaging in research activities, for example, Florida State University 
and the University of Wisconsin, but as yet these centers have not taken steps to organize 
explicitly as contexts for ceseSrch. 



/ 



30. 

A support structure through the college and the Teaching Research 
Division of the Oregon State System of Higher Education that 
provides assistance to individual staff members doing research. 

Other features pf the program add to its uniqueness as a research context. Three of these 
are (a) the OCE faculty has defined teaching competence as the ability to ^ring about the 
outcomes expected of a certificated teacher holding a certificated teaching position; 
(b) the ability to bring about such outcomes must be demonstrated in on-going schuol 
contexts; and (c) the most critical competence to be demonstrated is the ability to bring 
about desired learning outcomes in pupils. Such 9 definition of teaching competence leads 
to a powerful set of dependent measures for use in the research carried out at the Center. 

In addition, the OCE program is organized in such a way that blocks of 30 students can 
be systematically treated as experimental or control groups (each block of students is viewed 
as ari instructional unit within the program); all-faculty in the program have accepted 
common definitions, measures and performance standards relative to the teaching competencies 
to be demonstrated by graduates of the program; and all faculty have agreed to try alternative 
instructional programs and procedures to help students achieve competence as teachers, 
but to carefully document all programs and procedures tried. Approximately 240 students 
are enrolled in the.Elementary Teacher Education Program at the college each year, 
providing thereby at least eight instructional units for treatment as experimental or control 
groups each year. 

Th eParadiqm T hat Guides Res earch in the OCE^rogram 

The OCE-TR Paradigm for Research on Teacher Education has three defining characteristics: 
It is longitudinal; it is multi-dimensional; and it is mode"-dependent. These are described 
briefly in the paragraphs that follow. 

LONGITUDINAL CHARACTERISTICS. As planned now each teacher graduating from 
the OCE Elementary Teacher Education Prpgram is assessed for his or her competence as 
a teacher on at least six separate occasions. Three of these occur prior to graduation; three - 
follow graduation. The schedule for these assessments is as follows: 

Prior to graduation g 

. Lesson teaching 

. Short Term (2-5 days) FuM-Responsibility teaching 
. Extended.(2-5 weeks) Full-Responsibility teaching 

After graduation 

. During the first full year of teaching 

. Between the third and fifth full years of teaching 

. Between the seventh and the tenth full years of teaching 

MULTI-DIMENSIONAL CHARACTERISTICS. Five major 4ata sets are called for in the 
paradigm. These are (a) data on the background and personality characteristics of students 
preparirig to b^ teachers; (b) data on the characteristics of the tocher preparation program; 
(c) data on performance as a teacher; (d) data on critical features of the setting in which 
teaching tak« place, including the characteristics of pupils being taught; and (e) data on 
the reaming outcomes of pupils being taught. In combination, the fiye.data sets permit* 
an almost endless array of questions to be asked in relation to the Elementary Teacher 
Education Program and the effectiveness of teachers prepared through it. The data sets 
can be portrayed schematically as follows. 
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MODEL-DEPENDENT CHARACTERISTICS. The data sets within the paradigm, and 
the variables within each set, are referenced against (but not dictated by) three models 
that pertain to the preparation of teachers. These are (a) the OCE model of tasks to be 
performed by elementary teachers; (b) th? Spady model of teacher effectiveness: and.{c) - 
the Schalock model of the critical variables involved in instruction. The critical dimensions 
of the OCE model are reflected in the measures of teaching competency that are applied 
to all prospective teachers in tfie elementary program (the OCE-TR System for the Assessing 
Competence of Elementary Teachers, 1974). The Schalock and Spady models are described 
on pp. 18 to 19 and 24 to 25, respectively. 

Data Sets and Anaiysis Stratetjies 

Each of the five data sets included in the research paradigm is.made up of a number of 
measures. Table 5 con!ains a Irj^ting of these measures for four of the five sets. Descriptors 
of program characteristics are left to individual staff members interested in testing particular 
program effects. 

Usinjg various combinations of the five data sets a,broad range of questions about teacher 
preparation and its effectiveness can be addressed. The simplest and mo^ straightforward 
of these involve data from two sets; a more coniplex set of questions can be asked that involve 
three or four. Examples of questions involving iwo data sets are: 

The relationship betwee^program characteristics ^nd teacher performance; and 
The relationship between teacher performance and pupil outcomes. 

Examples of questions involving four of the data sets are: -t 
] The relationship between program characteristics and teacher performance, 
when variation in performance is controll^ for variation in both teacher 
and setting char acteristics ; and ' 
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The relationship between teacher performance ^/nd pupil outcomes, when 
I variation in performance is controlled for variation i n both teacher and 
I setting characteristics. 

in addition to questions that focus on the relationship between data sets, it is possible to 
raise questions about change in selected variables within sets. Change in tjacher characteristics 
or teacher performance over a period of years, for example, would seem as important to 
investigate as any of the questions suggested above. Obtaining answers to such questions, 
of course, requires careful control for the effects of maturation'and setting, but given such 
control, studies of change are as ^ily pursued within the OCE-TR paradigm as studies of 
relationships. 

Code books are being developed for each data set included in the paradigm. These will 
involve reasonably detailed descriptions of each of the measures included in each data set 
along with information from quality assurance studies as to the level of confidence that can 
be placed in them. ^ / 

Specific Research Plans 

As yet, few substantive studies have been undertaken within the context of the ETE 
program. Quality assurance and methodological studies have been a part of program operation 
since its begii^ning, but only one substantive study has been done to this time. This is a 
study thai compares the effectiveness of student teachers and first-yter teachers prepared ^ 
at OCE under the new (CBTE) Elementary Teacher Education Program and the old. While 
premature from the point of view of the quality of the measures used in the study, it had 
to be undertaken when it was because of the availability of the two populations studied. If 
the study had been delayed, it would never have been able to be made. ^ 

With the beginning of the 1974-75 academic year, measures of teaching competence hatre 
reached a point of stability that substantive research can begin to draw upon them. Also, 
sufficient energy has been freed from the demands of development that a progralVn of research 
could at least be contemplated. As a consequence, a reasonably ambitious program of 
research is being launched, and it is being launched without funds specifically earmarked 
for purposes of research. The hope is that by collecting data on the various measures 
outlined in Table 4 as a part of normal program operation, the data collection wpect of 
tfie proposed research will be feasible within the limited resources available. There is the 
further hope that entering all competency demonstration data into computer storage at 
the time it is pollected will make the data management aspect of the proposed research 
economically feasible. What is not clear is whiiier tfie limited resources available for 
analysis will balance the-resources i^eded, and whether the limited ttme and energy on the 
part of the faculty that can be given to research (all faculty at OCE carry full-time teaching 
loads) Will permi^full use and reporting of the data even if it is collected. 

Without funds for research, the coming year will afford a clear test of one of the central 
propositions underlying the OCE prpgram: tfiat high quality research can be parried out 
within the context of a CBTE program at little cost so long as tha data collect ed as a part of 
normal program operation is of a quality that will permit it to be used in research. The 
substantive research planned for the coming year is summarized in Table 6. Long range 
projections include plans for model testing and principal identification studies as well 
(see pp. 22 to 24). ' > 

In addition to the tubstantive studies planned for the coming year, a large number of 
instrumentation and quality assurance studies will also be carried out. These are listed in 
Table 7. These studies are seen as an integral part of program operation and* thus are 
carried out on axontinuing basis. J 



Table 5. A Summary of Variables On Which Measures Are Taken In The 
OCE TR Paradigm For Research On Teacher Preparation 
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TEACHER CHARACTERISTICS VARIABLES 



Background Characteristics 
SES 

Birth Order 

Experience with children 
Physical Characteristics 



Sex 
Age 

Body type 
Scholastic Ability 



s 



College GPA 
SAT Scores 

Scores on the abstract-concrete 
thinking scale of the 16 PF test 



Personality Characteristics 

Selected measures from the 16 PF test 
Selected measures from the Edwards * 

Personal Preference Inventory 
Selected measures representing various 

combinations of 16 PF and Edwards scores 

Attitudinal Characteristics 

Attitudes toward self 

Attitudes toward teaching in general 

Attitudes toward selected aspects of teacbinjg 

Preferred Learning Style And Cognitive 
Orientation 



TEACHER PERFORMANCE VARIABLES* 
Competency Cluster I. Planning and Preparing for Instruction 
General Planning 

1.1 Thoroughm^ 

1.2 Appropriateness 

Special Unit Planning 

1.3 Desired learning outcomes 

1.4 Indicators of outcome achievement 

1.5 Strategies, materials, and procedures 

Competency Cluster II. Performing Instructional Functions ^ 

2.1 Conveying learning outcomes desired from instruction 

2.2 Adapting instruction to context * 

2.3 Building motivation and interest in learnfhg 

2.4 Providing for variety in instructional activities and levels of thinking 

2.5 Dealing with subject matter 



*The dimensions of performance listed are those that appear in the assessment system 
used at the point of entry into the profession (INITIAL Certification). The system is 
presently being extended to cover advanced levels of certification. 
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2.6 Managing the use pf instructional materials, procedures and activities 

2.7 Managing potentially disruptive events 

2.8 Manuging transitions and terminations 

2.9 Assessing learning outcomes 

2.10 Planning instruction of the basis of learning outcomes - ^ 

Competency Cluster III. Summarizing And Interpreting Learning Outcome Data 

• ' > 

3.1 Summarizing data 

3.2 Imerpreting data " ^ 

3.3 Using data to'pian next stops 

Competency Cluster IV. delating Interpersonally ^ 

_4.1 Responding to pupils concerning instructional matters^ 

4.2 Resppnding to pupils concerning personal matters - ^ 

4.3 Relating to supervisors,, principals; curriculum specialists, etc. 

Competency Cluster V. Performing Related Professional Responsibilities 

^ 5.1 Managing non-instructional activities 

5.2 Meeting work schedule dem^ds 

5.3 Maintaining the learning environment ^ 

PUPIL OUTCOME VAf/iaBLES 

Process Outcomes 

6.1 Pupil involvement in the instruction-learning process 

6.2 Pupil feelings about the instrMCtiori-learning process 

6.3 Pupil responsiveness to the teacher 

Product Outcomes: From a 2*5 week Full-Responsibility Teaching Experience 

7.1 Knowledge and skill outcomes o 
. 7.2 Attitudinal outcomes 
^ 7.3 Other outcomes, f oijaxample, reading skill and comprehension outcomes; 
problefp solving and social interaction outcomes 

"-l^rodu'ct Outcom^: From a diagnostic-developmental project with three or more individual 
children 

. " , ' DESCRIPTORS OF THE SETTING !N WHICH TEACHING OCCURS 

Characteristics of the School in Which Teaching Occurs 
Location 

Organization of space , , 

^Organization of curriculum * , 

O Organization of faculty ^ o * 
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Characteristics of the Classroom in Which Teaching Occurs 

Number of pupils 
Pleasantness of surroundings 
Availability of materials 

Characteristics of Pupils Taught 

Modal age 
Grade level 
Ratio of boys to girls 

Ratio of Children with above average intelligence 
Ratio of children from above average socio*«conomic families 
.Ratio of children from Caucasian parents 
\ Ratio of children with physical impairment 
Ratio of children with inteMectuai impairment 
'.Ratio of children with emotional impairment ^ ^ 

DESCRIPTORS OF THE OCE ELEMENTARY TEACHER EDUCATION PROGRAM 

(To be provided by individuaLstaff members doing research on program effects*} 
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^ Table 6. Substative Research To Be Pursued Within The Context 
Of The Elementary Teacher Education Program At OCE 
^ During thei974-75 Academic Year 



POLICY-ORIENTED STUDIES 

Cdlf^Benefit §tudies 

On-Lin^rogram Evaluation Studies 

the coliectidih of program adjustment data ; f 
the collection of progra^n design data 

PRACTICE-bRlfeNTED STUDIES 
Follovt; Up Studies \ j 

. on first year graduates ofthe ETE program^ _ ^ 

on drop-outs from the ETE fMTOgram ""^ 

//' 

On-Line Studies of Short Term Program Effects 



Continuation of the Study on^^e Effectiveness of Student Teachers Prepared at OCE 
Under Competency and l^on-Competency'Based Programs * 

/ BASIC RESEARCH STUDIES ' , < 

Hypothesis Testing Studies 

predictors of teacher responsiveness to pupil needs and circumstances 
* teachei^ responsiveness to pupil needs and circumstances as a predictor of teaching 
success / > • . ; 

Hypothesis Geher^ing Studies ' f " 

a search for correlates of competency 

. mastery of knowledge and skills that pertain to teaching ^ 
. . petf:^al characteristics such as age, sex, academic ability and.body type ^ 
. personality characteristics 
. attitudinal characteristic^ 
. background characteristics 

. the characteristics of the setting in which teaching occurs 
studies of change 

. in personality 
. in attitudes 

. in dejTionitrated teaching competence 
a search for correlates of change 

, . mastery of knowledge and skills that pertain to teaching as correlates of change 
in personality an^attitude 
. demonstrated teaching competence d$ a corrv * .e of change in personality 
and attitude 

9 A 



Table 7. Methodological Studies To Be Pursued Within The 
Context Of The Elennentary Teacher Education 
Program At OCE During the 1974-75 Academic Year 





• QUALITY ASSURANCE STUDIES 
Form Use Studies \ 
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Indicator Use Studies 

.Rating Patterns And Distribution Studies 

Inter-Rater Reliability Studies 

DATA DISPLAY STUDIES 

The Display Of Quality Assurance Data 
The Display Of Competence Data 

The Development Of Procedures To Prepare And Display Cost-Benefit Data 
y INSTRUMENTATION STUDIES 

The Refinement Of Instruments 

Used in Assessing Teaching Competence 

Used in Assessing Attitudes Toward Self and Teaching 

> ♦ 

Used in Assessing Learning Style and Cognitive Orientation 

Used in Assessing the Setting in Which Teaching Occurs 

The Predictive Power Of Competency Measures Obtained Under Differing Conditions 
Of Teaching ' 
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Documentation Studies 

Serious efforts are being made to describe the volutions of CBTE at Oregon College 
of Education and in the state at larcp. This is being done for two reasons. The first has 
to do with a sense of history. CBTe represents a major dei/elopment in teacher preparation 
in the United States, and its evolution within an institution and state should be recorded 
as fully and as accurately as possible. The second has to do.with what might be helpful 
to othen. The availability of well-documented case studies of CBTE efforts in states and 
institutions could have genuine utility ^ others who are attempting to implement such 
program*. While it is recognized that each institution and state must make its own particular 
adaptation of CBTE, being able to draw upon the developmental histories of others could 
be of considerable help in doing so. 

Three documents have been produced thus far that describe various aspects of the Elementary 
Teacher Education Program at OCE. These are, in the order in which they have been 
produced, 

Schalocki H.D.; B.Y. Kersh; and J.H. Garrison From Commitment to Practice in ^ 
Assessing the Outcomes of Teaching: A Case Study, in T. E. Andrews (Ed.) 
Assessment in Performance-Based Teacher Education . Albany, New York: . ^ 
Multi'State Consortium on Performance-Based Teacher Education, 1974. 

Schalock, H.D. Notes oh a Model of Assessment That Meets the Requirements 
of Competency Based Teacher Education, in W.R. Houston (Ed.) Exploring, 
Competency Based Education, 1 974. 

Albritton, R., and staff of the OCE program. A Case Study ^ The OCE Com- 
j petency Based Teacher Education Program, (The program description on which 
^- the 1974 AACTE Distinguished Achievement Award was granted.) 

Two documents have been produced that describe the Oregon translation of CBTE principles 
into accreditation standards. These are: 

The Process Standards for Educational Personnel Development Programs: 
prepared by the Oregon Teacher Standards and Practices Commission, 1973; and. 

An interpretive paper that spells out the implications of the proposed 
Process Standards for defining and assessing teaching competence 
(Schalock, 1973). 

These and other products developed at the OCE-TR Center for Competency-Based Education 
are described in a brochure that may be obtained on writing this college or Teaching Research, 

Three additional documentation efforts are underway: a description of both the development 
and operation of the AACTE award-winning Elementary Teachfer Education Program at 
OCE; 8 description of CBTE in Oregon as a whole; and a description of CBTE in the 
Northwest. The description of the Elementary Teacher Education Program at OCE is to be 
published as a monograph in the AACTE Series on competency-based teacher education. 
The description of CBTE in the state as a whole derives from a study that identifies in each 
teacher preparation institution in Ae state all program elements that reflect features of 
the competency-b^ teacher educatFon movement, and the extent of their development. 
The results of this study are to serve as a baseline against which to chart progress in CBTE 
in Oregon following the state's adoption in July of a new set of standards for program 
approval that reflect the essential features of competency-based teacher education. A 
Import of thisstddy may be obtained by writing to either Dr. Richard Jones, Executive 



Director of the Oregon Teacher Standards and Practices Commission, or Dr. Del Schalock 
at the Teaching Research Division of tl)e Oregon State System of Higher Education. 

A set oi protocol materials is bein^ developed to document CBTE within the Northwest. 
The aim of the study is to develop af set of slide-tape presentations that presents the basic 
concepts of competency-based teacher education, as those are portrayed in the Cornfield 
model of CBTE, and to document how these concepts have been interpreted and implemented 
within the various states of the region. Two protocols are being developed for each 
Northy^tern state, one describing the position of the State Department of Education 
towarid CBTE, and one describing hoA that position has been translated into program by 
an/institution within each state. 

A Nine slide-tapes are to be developed in all. It is anticipated that the protocol project 
M\\ be completed by early Fall, 1975. 

/ 
/ 

The CBE Center The University Of Toledo 

As A Context For Research ^ . 

The CBE Center at the University of Tole«io has not progressed as far in its implementation 
of the research function as the OCE-TR Center, but it is well on its way. Faculty and 
^ administrators of the University have declared the research function; they have begun to 
organize for it; and they have developed a model that is to guide the major research thrust 
within the Center. The pages that follow outline the research model developed at the University 
of Toledo and the plans that have been made for its implementation. 

Any research modef that would provide for comprehensive research in CBTE would of 
necessity require great specificity before it could be operational ized* It is not the purpose 
of this discdssion to provide such a detailed description. Rather, the purpose here is to 
provide a broad framework within which the specific details of conducting research can be 
developed. The ideas of the broad model discussed herein were initially presented by Donald 
Medley, and subsequently developed further by Robert Soar and the University of Toledo 
staff. ^ 

The major context within which research in CBTE is focused iV^iagrammed in FiguretS. 
The focus of the research is upon the relationships between teacher behavior and pupil 
outcomes, and the effects of variations in teacher behavior upon pupil outcomes. When an 
undergraduate program in CBTE is being researched, the teacher behavior is that or under- 
graduates in the program, manifested through student teaching, participation, or other under- 
graduate activities. Pupil outcomes may be in the form of immediate behaviors or more long- 
range outcomes. Examples are observations of classroom behavior, scores on standardized 
tests, and scores on affective inventories. 

The chain of effects in going from teacher behaviors to pupil outcomes has a multitude 
of interrelated links or factors. In the model of Figure 3, the major focus is upon the center 
boxes, with pupil behavior and outcomes being overlapping to some extent. The teacher 
training program is a md]QL>factor in shaping teacher behavior, but other factors also in- 
fluence both teacher beh^ior and pupil outcomes. Examoles of these are listed in the figure. 

Within the context of the variables presented in Figure 4, a multifaceted research program 
can be generated. Certain components of such a program^ would be sequential: others would 
\ be concurrent. The program could be developed for both elementary and secondary CBTE, 



What follows has been prepared by Dr. William Wiersma, Jr., University of Toledo. 
Another excellent description of the CBTE program operated by the University has been 
prepared by Dickson, Saxe, et al. , (1973). 
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or It could be limited to a subgroup of teacher-education students-for example, those pr^ 
paring to be secondary mathematics teachers. 

A logical starting point with a research program would be the generation of correlational 
data relating variables between the boxes of Figure 3. (Variables within boxes could be 
considered singly, as composites, or as any combination.) Correlation coefficients would 
not, of course, in themselves bft conclusive evidence of cause and effect, but they would 
provide a base for generating hypotheses. The data necessary for the teacher education 
portion to a large extent exists, although in the past it has seldom been systematically ^ 
collected. Data for the pupil outcomes, school context, etc. have been collected in the past, 
although seldom in connection with research in teacher education. 

In implementing a research program, it is anticipated that new systems of data monitoring 
and collecting will be developed. Also, it is not likely that existing measurement instruments 
will prove adequate, especially on the teacher education end, and therefore at least some 
new measuring instruments will be developed. 

After a number of hypotiieses have been generated, it will be possible to move into three 
situations for testing hypotheses: (1) Ex post facto field studies, (2) field experiments, 
and (3) laboratory experiments. To some extent these kinds of studies can be conducted 
concurrefitiy. With a subgroup of teacher^ucation students In a program, it may be 
desirable to conduct the studies sequentially, reversing the order listed above. This sequential 
ordering is not a prerequisite, but it may prove convenient for the schedule of the training 
program. / % 

Laboratory experiments provide the situation of greatest ejcperim^a! control. Many of 
th^ experiments would be conducted on campus, although this is not a requirement. Peers 
of |the teacher-education student, and possibly selected groups of pupils, would serve as 
th^ subjects for the laboratory experiments. 

Th^ field experiments would be conducted primarily during student teaching or comparable 
experience. In the field experiments situations, the experimental control would be less than 
with the)abpratory experiments, but at least some measure of control could be exercised. 
For example, the kind of teaching strategy used and the cpntent of a lesson could be 
specified and explicitiy developed prior to the field experiment. 

Field studies can take place under a number of conditions. Less controlled situations 
during the student-teaching experience would be an example. The field studies would 
apply to programs that incorporate some type of intern ^experience. Aho, field studies could 
be used for the followup of first-year (or later) teachers. Any situation which could not 
improve its experimental control, but in which appropriate data collection can take place 
would be usable for a field study. 

As the research data are generated, the relationships and corresponding inferences betv^pen 
the variables of the boxes of Figure 3 would be identified and developed. The stronger 
inferences are likely to come between variables of adjacent boxes. However, with a systematic 
study of the variables, the chain of inferences should be completed from the teacher training 
program variables to the pupil outcomes variables. 

Th*1ffatter of data analysis is primarily a technical matter, but the research model lends 
itself to a variety of procedures. Bivariate correlation, multiple regression, canonical ' 
correlation, factorial analyses (both ANOXIA and GOV), and factor analysis are possible 
analysis procedures. Analyses vyill, or course, tiejp^d upon the hypotheses being lested 

The research model discussed herein focuses directfy upon the variables in the teaching- 
learning context Within this context it has broad and comprehensiv(9 application. It does 
not focus on research of matters such as university policy and funding procedures, although 
ihe results might wo^i have implications for such matters. 
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PART VII. PROBLEMS, PROSPECTS AND A PLAN OF PROCEDURE 



Outlining the kind of research and development program needed in relation to CBTE is 
one thing, implementing what has been outlined is something else. It seems appropriate, 
therefore, to close a paper of this kind with a brief look at the task of translating what has 
been proposed into practice, and to offer at least tentative observations as to how that 
translation process might take place. 

Some Anticipated Protiiems 

It has been argued that-only now is it possible to begin to undertake the kind of research 
and documentation studies that have been called for in the paper b^ause only now are 
functional CBTE programs beginning to be established. It is simply not possible to compare 
the cost and benefits of CBTE with non-CBTE programs until CBTE programs are available 
for comparison. The same argument obvioi^ly pertains to using CBTE programs as contexts 
within which to carry t>ut practice-oriented research, basic research, and documentation 
studies. 

Even though illustrative CBTE programs are now beginning to emerge, a host of problems 
remain before the kind of research and documentation called for in the present paper can 
be undertaken. Many such problems were referred to in the course of the paper-for example, 
finding CBTE programs that are witling to face comparison with otiier programs or that are 
willing to accommodate the demands of ongoing practice-oriented and basic research studies. 
Other problems remain, however,,and need at feast to be identified. The more important 
of these would seem to be 

Assuring the continued development and operation of 
competency-based teacher education programs as 
demonstration and research contexts; 

Securing the funding level needed to carry out the 
research and documentation studies outlined in the 
present paper; 

Finding competency-based teacher education programs that 
are at a level of development and possess sufficiently 
competent staff to carry out the kind of research and 
documentation programs outlined; and 

Fixing responsibility for the long term coordination and 
management of the research and documentation program 
called for, 

A number of these problems revolve around the availability of funds. This is obviously 
the ca$6 with respect to the research activities that have been proposed. Funding is also 
involved, however, in the continued development and operation of CBTE programs. 
Unless viable CBTE programs exist, most of what has been proposed is, in the parlance of 
the day, inoperative. 

Some of these problems are not so mych a matter of money as they are the availability 
of personnel who are competent to carry out the necessary functions. In this regard, two 
broad' sets of functions need to be performed: developing and maintaining a CBTE program 



that can in fact support the kind of research that has been called for, and actually carrying 
out the research and documentation activiti^. 

Finally, a number of these problems are plainly and simply a matter of the National 
Institute of Education's and the U.S. Office of Education's agreeing to the importance of 
the kind of research and development effort that has been outlined; to the probability of 
its short- and long-term contribution to the betterment of education and teacher education 
in the nation; to the priorities of the proposed program as compared to the priorities of 
other programs that are being supported; to.the priorities of the various activities called 
for within the over-all program; and to the responsibilities to be assumed individu^y and 
collectively by the two agencies for the implementation, funding and management o^|he 
program. In approaching the various problems and issues that have been identified, it i^ 
recommended that the last issue mentioned be attended to first, since decisions reached at 
that level will largely determine what happens in relation to all else. 

Some Optimistic Projections ^ 

Assljming the National Institute of Education and the U.S. Officepf Education were i- 
able to reach the decision that the proposed program is worth su^^^i^^, that it had high 
priority in relation to other programs, that agreements were able to be reached in terms of 
shared r^ponsibility for supporting and managing the program, that a reasonably high 
level of funding was made available to the program, and that operational CBTE programs 
could be found that were willing to serve as research contexts, what could be expected to 
emerge from the program at the end of a three year period? At the end of five years? 
At the end of ten years? The projections that follow attempt an answer to these questions. 
They assume that all lines of inquiry that have been recommended are to be supported. 

Products And Conditions At The End Qf Three Years 

DATA FROM POLICY-ORIENTED STUDIES 

Preliminary data on costs and benefits of CBTE and non-CBTE programs 

Preliminary data on costs and benefits of alternative forms of CBTE programs 

Methodologies, settings, and personnel -established to carry out long-term policy studies 

DATA FROM PRACTICE-ORIENTED STUDIES 

Preliminary data on the costs and benefits associated with selected in- 
structional practices within particular CBTE contexts 

Methodologies, settings, and personnel established to carry out long-term 
studies of the costs and benefits associated with selected instructional 
practices within particular CBTE institutions 

Methodologies, settings, and personnel establishedltocarry out cross- 
institution replications of cost and benefit studies on selected in- 
structional practices 



DATA FROM BASIC RESEARCH STUDI ES 

First level taxonomtc work cofYi|!)leted in relation to the construct 
^ delineation studies, related literature reviews completed, design 
and measurement methodologies tested, and some replication 
data on constructs that have appeared promising in existing 
Education and psychology literature ^ 

Theoretical r^itions that link ti^ constructs identified in the 
research paradigm stated at an initial level of detail, related 
literature reviews completed, design and analysis methodologies 
tested, and studies in progress that test the soundness of the 
theoretical structores that guide the assembling of variables. 

Initial models to be tested identified, variables witfiin the models 
delineated, rjetated literature reviews completed, design and 
and analysis methodologies to be used in testing the models 
specified, and studies in progress to both clarify the variables 
involved and establish trustworthy measures for their ' 
investigation 

CASE STUDIES FROM THE DOCUMENTATION EFFORTS 

At least three case studies on selected CBTE institutions covering 
at least two years of development and implementation decisions 

At least six case studies on select attributes of competency- 
based teacher education that have a two-year history of 
development and implementation 

i 

Productr And Conditions At The End Of Five Years 

DATA FROM POLICY-ORIENTED STUDIES 

Sufficient data on costs and benefits of CBTE and non-CBTE # 
programs that policy decisions can be made with reasonable 

_ confidence—™-- — — „ ^ , _ „ . , _ _ 

Sufficient data on costs and benefits of alternative forms of CBTE 
programs that policy decisions can be made with reasonable 
confidence 

Methodologies, settings, and personnel established to carry 
out whatever additional policy studies are needed 

DATA FROM PRACTICE-ORIENTED STUDIES 

Sufficient data on the short-term costs and benefits associated with 
selected insmictional practices in particular CBTE contexts that 
program implementation decisions can be made with reasonable confidence 

/ 



\ 



/ 



Preliminary date on the long-term costs and benefits associated with 
^ selected instruc^bnal practices in particular CBTE contexts 

Initial replicatipns across institujtional settings of cost/benefit studies 
on selected ihstructiorial practices 

DATA FROM BASIC RESEXrCH STUDIES 

* An initial set of empiricallVgrounded constructs within each cluster 
of variables identified in thrmearch paradigm that has been proposed 

Measurement methqdologes firbly established for each construct 
within each cluster of variables iri the paradigm 

/The theoretical structures that iink the constructs identified in the 
research paradigm reasonably well worked out, and reasonably 
productive in terms of hypothesis ger»eration 

Design and analysis methodologies firmly established for research 
on principles of teaching, given the constraints of the paradigm 
governing principle related research 

A beginning collection of ^pirically based principles of instruction 
that are suggestive of the nature of the interactions between the 
variables listed in the paradigm on teaching. 

Measurement methodologies firmly established for each variable 
in the various models to be tested, and initial test of the utility 
of the models underway 

CASE STUDIES FROM THE DOCUMENTATION EFFORTS 

Completed case studies on liiree selected CBTE institutions {each 
case study would cover a four-year period of time) 

Six additional case studies of selectedattributes associated with 
competency-based teacher education prograij^s that have had at least 
^ a two-year history of development and implementation Unakiffg 
a total of twelve such documentaries) 

At least three case studies covering a two-year period of time on 
institutions that are serving ds centers for research in CBTE 

s 

Pro ducts And Conditions At The End Of Ten Years 
DATA FROM POLICY-ORIENTED STUDIES 

The completion of whatever cost-benefit stucjies are needed on CBTE 
as opposed to non-CBTE programs \ 



The completion of ^whatever cbst-benefit studies are.heeded on 
alternative forms of CBTE programs * 

DATA FROM PR ACTICE-OR I ENTED STUDI ES 

Short-term cost and benefits studies essentially coit^leted on 
selected instructional practices within particular CBTE contexts 
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Sufficient data on long*term cost -find benefits of selected instructional 
practices in particular CBTE contexts that program decisions can 
\y be nriade with reasonabl^confidence 

Sufficient cross-institutional replication data on cost-benefit 
studies of selected instructional practices that program 
decisions by a wide variety of institutions can be made with 
considerable confidence 

DATA FROM BA^ RESEARCH STUDIES 

Second-generation construct delineation research underway , 
and the theoretical structures within which constructs rest 
under empirical test 

Second-generation methodology and design in relation to 
construct delineation studies under development 

A sizeable number of principles of teaching established, and 
established with sufficient confidence that program design 
^as well as on-line teaching is able to benefit from their 
application' 

An initial set of models tested, refined, extended, or replaced > 
^th more promising models, and these in turn ready to be 
submitted to empir{cal test. 

CASE STUDIES FROM THE DOCUMENTATION EFFORTS 

Alt case studies on CBTE programs and program elements completed 

Ail pase studies on CBTE programs as contexts for research 
completed ^ 

Figure 4 represents a translation of these projections into a simple time/task chart., 

A Plan Of Procedure 

Any of a dozen strategies could be followed in implementing the program of research 
and documentation that has been proposed. Each would have advantages and disadvantages; 
and more than one would undoubtedly prove to be successful. Be that as it may; a number of 



€>4 



00 



o> 



I 
I 
I 

\ « 
» \ 

\ 



I 1 



A7. 



5 

% 

Q 
LU 

Z 

LU 

£ 

9 
> 
o 

Zi 

2 



.1 

■6 

S c 
=5 .2 
B ^ 

ffi E 

§ s- 

UJ Ui 
H H 
CO ffi 
O O 



CO 
UJ 

5 

D 
H 

o 

UJ 
H 
Z 
UJ 

£ 
o 

Ui 

o 

H 
O 
< 

CL 



(O CO 

c c 
o o 

11 

li 

c c 




E 



S 
8> 



ERIC 

hfiiinniiinrfTiaaiia 



* 48. 
recommeridations are offered at this point to assist in its implementation. The recommendations 
assume Nf E aQd OE agreement as to joint sponsorship of the proposed program, and agreement 
as to the division of responsibilities therein. 

1. Begin work on all aspects of the research proposed, even though there may not be 
enough money to do so on a (arge scale. All of the research efforts^utlined need 
to be done; each will contribute to the other; and each will serve the needs of 
different audiences. , ' ^ ^ 

2. ^ Take fiilly into account the program development work needed in order to carry 

out the research that has been proposed, and then see to it that the develophtent 
and the r^Ciarch aspects of the^over-ait program are closely coordinated. Without 
' such attention to development there is danger that the research contexts on which 
the entity proposal is predicated will not be available. ^ ^ 

3. Share the research and development costs across federal agencies; for example, \ 
have NIE assume the costs of research and OE assume the costs of development ^ 

' « and documentation. *s 

• ^ J ' 

4. Keep responsibility for managing the over-alhreseafch-program a federal responsibility, 
rather than a state or non-federal responsibility. 

a* 

5. Hinge the program on competitive proposals that are in response to RFI^'s. 

6. Direct most of the funding for research to institutions that have CBTE programs that ^ 3 
can^function as R&D contexts (funds should not be directed to existing R&D Centers 
unlgss they are linked to CBTE programs that meet the criteria for CBTE* research 

\ centers). 

^ 7. Before letting research contracts to any institution, establish carefully the characteristics 
f needed by an institution to carry out the various research and development activities 
being called for. ' • - 

a. 

8. Implement a dissemination function of major proportion^, and target the research 
and documentation results to be disseminated to the audiences for which they are 
particularly appropriate. > / 

Obviously^ the research program proposed is a massive undertaking. It is also, an extremely 
complex one, and one that in the minds of many would be tpo slow to produce results 
or too grandiose ever to get started. In the judgment of the members of the Consortium 
of CBE Centers, however, ^nd it is a judgment that has been care|ully weighed, it is precisely ^ 
this kind of research program that is needed in order for teacherisducation pYograms ever 
to make the kind of difference in teaching that they are supposed to make. The irony and . 
hope is that by using CBTE programs as contexts for research, costs will be sufficiently 
reduced and the problem bf the external validity of experiements sufficiently overcome, ^at 
the program of research that has been proposed can be carried out successfully. 
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COMPETENCY BASED DEVELOPMENT IN THE 
CONSORTIUM OF SOUTHERN COLLEGER FOR 
TEACHER EDUCATION: A DOCUMENTATION STUDY^ 

Project Background j 

This competency-based teacher education project had its genesis somewhere in former 
Defense Secretary McNamara's notion of project management and accountability which 
he brought from industry. Additionally, there were roots to be found in the programmed 
instruction movement of the post-Sputnik late 1950's and early 1960's. Most people, 
however, saw its germination in the U.S. Office of Education's Comprehensive Elementary 
Teacher Education Models (CETEM) program which was born on October 16, 1967 when 
the National Center foiJ^ducational Research and Development (NCERD) issued a request 
for proposals to develop*^pecif ications for program models for the preparation of elementary 
teachers. One of the eligibility requirements for participation of a college in the CETEM 
program was that it must graduate one hundred elementary teachers annually. This re- 
quirement eliminated smaller colleges such as most of those in the Consortium from the 
competition. Recognizing both the need for smaller institutions with limijedresources 
to participate in change in teacher education and the need to see if the CETEM programs 
were at all relevant to such schools, during 1969-71 NCERD provided minimal support 
for ten southern colleges (the Consortium) to band together to accompKsh these purposes. 
Initial Consortium efforts then were focused on examining the CETEM efforts and designing 
competency-based teacher education (CBTE) programs on each of the campuses of member 
institutions. 

Proj ect Funding 

In January 1972, $96,000 was given to the Consortium to develop, implement, and 
evaluate the CBTE designs which had been growing in the minds of Consortium members 
over the previous two years. "Project management was given over to three former members 
of the Livingston State University faculty (Livingston had withdrawn from the Consorffiim) 
who became known as the Research Team or RT. The RT located at the University 6f 
South Alabama which became an Associate Member of the Consortium. 

Project O bje ctives 

In its proposal to USOE the Consortium stated the following objectives for the project: 

1. That each Consortiufn member would develop CBTE programs suitable • 
for use in other small colleges and universities. That each member's teacher 
education program would include an operating management system, a 
faculty development system geared toward CBTE implementation, and 

a community involvement mechanism. 

2. That certain parts of the CBTE programs (specificalty Learning Laboratories, 
Simulation Laboratories, and Human Relations Laboratories) would be 
developed and tried out in regional demonstration centei^ to determine 
their effectiveness. 



'Fortney, H. M. and F. C. Judge. Developmen t and Effectiveness of Competency Based 
Teacher Educat i on Progr ams in Emerging Institutions. Final Report to HEW, May, 1973, 
Consortium of Southern Colieges, University of South Alabama, Contract No. 
OEG-0-72.0778. 
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3. That the Consortium would establish a central office for teacher education 
program development wherein a repository and information dissemination 
service would be housed. This Center would establish and maintain con- 
tacts with others involved in CBTE and ^acher education generally. 
Specific mention is made of AACTE, ERIC, National Laboratories, and 

R&D Centers, commercial publisher, the national protocal and training ^ 
materials project, state education agencies,"and training complexes.) In 
addition, the Center would conduct conferences, assemble task forces, 
and publish a newsletter. 

4. That the Consortium Center would develop a consultation service to 
assist other small schools interested in CBTE. 

5. That the feasibility of faculty and student exchanges which would strengthen 
teaching and learning in CBTE progi'ams would be determined. 

• 6. That Consortium CBTE*trained students would be compared to 

traditionally trained students. ^ 

7. That the results of Consortium efforts would be widely disseminated by the 
Center. ^ 

\ 

These seven promises were subsumed under four major project gp4ls as follows: ( Numbers 
in parentheses correspond with the promises. Note some prom^es are related to t^ore 
than one goal.) 

Goal 1 : to design, develop, implement, and evaluate CBTE programs at 
Consortium schools (t) 

Goal 2: to develop and demonstrate selected program components (Learning. 
Lab, Human Relations Lab, Simulation Lab, and Portal Schools) for 
Consortium schools and selected others (2,4) 

^oal 3: to compare modular-trained students with traditionally trained students (6) 

Goal 4: to design, develop, impiement and evaluate Improved Consortium 
organization and services (3,4,5,7) 

Major Activities and Accomplishments 

Two sources of information were used in determining what the project accomplished* 
The first source was the Research Team (RT) located in Mobile which w^ responsible 
to the Consortium for accomplishing the project's goals. The second source was the 
individual participating colleges. 

Goal I : M ajor activities and accomplishments in relation to designing, dyyeloping, 
implementing and evaluating CBTE programs at Consortium schools. To facilitate the 
accomplishment of Goal I, the RT made visits to the eleven Consortium schools in order 
(1) to determine how involved each w«s in CBTE activities, ji) to establish with each school 
a systGtns approach to follow in order to maximize efiforts.r end (3) to conduct faculty 
deveiopment conferences on a variety of topics, e.g., developing and writing competencies 
and developing modules. Between July, 1972 end mid-January, 1973, seventeen RT visits 



^Adopted from Donald R. Cruickshaifk, toncepiualizing a Process for Teacher Education 
Curriculum Development, Journal of Teacher Education. Spring. 1971. ^ 
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were made with the intention of working toward the accomplishment of Goal I. Extensive 
written documentation is available that the Goal I visits were well-planned and executed. 
Special efforts were made to put personnel and S(Aiools on tasks and deadlines and to 
^ increase the number of participating faculty. 

Work toward Goal I probably was slowed wjt^en a technical assistance grant was made to 
the Consortium to help pther small colleges outside the Consortium to work toward CBTE. 
From August, 1972 until mid-January, 1973 it appears that 27 RT staff days were contributed 
toward technical assistance exclusive of preparation and travel time involved. This is at 
least the ^uivalent of a month'?^ productivity for one staff person. A technical assistance 
grant, oot^orthy asr its objective mpy be, should be supported'by the additioB of professional 

V staff to the RT. This did not seem to be the case. 

Y Furthermore, other staff days were given to other valuable but extra-curricular events, 
such as organizing or participating in CBTE conferences sfK)nsore*by professional associations 
and state education departments. 

All of these peripheral activities have to detract from work toward the gdal of developing, 
implementing and evaluating CBTE at Consortium schools. On the other hand, RT participation 
in providing technical a»istance must be reinforcing to Consortium members. It must make 
them feel that ttieir efforts, to some extent, are being widely disseminated and recognized. 

7\$ mentioned earlier, a second source of information was the Consortium schools. An 
Instrument was sent to all eleven member schools to assess the progress each had made 
toward one or more of the four goais undertaken, in order to assess progress toward Goal I, 
respondents were asked (1) to list major activities undertaken to design, develop and implement 
CBTE; (2) to list future activities; (3) to describe major accomplishntents; (4) to describe 
the extent to which Goal T would be accomplished bv the-close of tfie project period on 
June 1, 1973; (5) to describe the extent to which it had developed management, faculty 
dfvelopment, and community involvement subsystems;,(jB) to list names, positions and 
duties of key personnel; (7) to make recommendations^to other schools about to enter 
into CBTE. Following is a report and analysis of the information received in relationship ^ 
to each of the seven queries listed above for Goal I. 

An examination of the major activities reported by member schools to accomplish Goal I 
revealed substantial agreement on the process followed as they moved toward a CBTE program. 
The most frequently reported major acti^/ities were: 

— ( ' 

1. All ^hoois began by selecti&d faculty or administrators becommg more aware 

of the Comprehensive Elementary Teacher Educi^tion Model (CETEM) programs. 
This was accomplished either by reading the final reports, visiting or bringing in 
consultants from the sponsoring institution, attending the AACTE dissemination 
conferences or combinations of the above. All schools began this way probably 
because they were mandated to study the CETEM programs according to their 
first federal contract. 

2. A second order of events seemed to be designed to gain the support of the college 
administration and particularly the faculty. Even though schools had the 
Consortium, it seems clear tb«t there was considerable unevenness to that pledge 
or at least to the ability to carry it out. In this regard members mention holding 
on-campus faculty workshops on the general nature of CBTE and attending simiSar 
meetings held elsewhere. 

3. Closely retated to the second type of activity was an effort to involve local education 
agencies in CBTE. In several instances, CBTE proponents conducted meetings for 
both insiders and outsiders. Teacher Corps and Triple T Projects were often m; 
between groups which seemed to have a strong impact throughout the development 
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of CBTE, the former often furnishing personnel and financial support. Since some 
Washington Teacher Corps Staff (particularly Dr. James Stetfensen) were associated 
with the CETEM program which advocated CBTE, this support was welcomed by 
the Consortium. 

4. Once understanding and broader support seamed to have been secured, colleges 
become more task-oriented. Several mentioned that they considered CBTE in relation 
to the current program and identified over-all goals for the new CBTE program. At 
this point decisions were made to revise the current program and/or to develop a 
parallel one. 

5. Further meetings of a faculty development nature were held to discuss the notions 
of competencies and modules. 

& Accompanying the above activities was often the need to decide how competencies 
should be derived. The following alternatives were often considered: 

a. Extrapolating competencies from present courses using course goals. 

b. Selecting competencies from prepared lists. 

c. Extrapolating competencies from concepts, skj|ls, and attitudes teachers need 
to ensure pupil learning. 

d. Analyzing teacher^behaviors and extrapolating competencies therefi%>m. 

e. Deriving con^petoncies from research and other authoritative sources, {^n 
most cases members used strategy a, above probably because some relationships 
could be established between what professors currently were teaching and CBTE.) 

7. The next step was the establishment of individual or group assignments and deadlines 
or schedules of work, although most schools did not take scheduling too seriously, 
preferring to go as fast as permissible. 

8. Once into module writing, it became evident that access to available modules developed 
on other campus was necessary; staff members began to identify and send for materials 
which were related to their tasks. Surprisingly few people seemed to know of the 
libraries of tnodules being gathered at Consortium Central. 

a An awareness also developed that more and/or better field settings (often referred to 
as Portal Schools) were required wherein CBTE students could learn and/or demonstrate 
skills. Simulation and microteachirig labs also were established in most schools since 
iK^th methodologies permit the acting-out of teaching behaviors for analysis. 

10. Learning Centers were developed wherein curriculum materials were housed and where 
teaching and learning could occur. Learning Ceriters-seem to^ange from fairly 
traditional instructional materials centers to combinations of teaching-learning materials 
development operations. Several Centers were hardly adequate in terms of space, 
materials, services and availability, although all had plans to become more functional. 

11. Determining how competencies can be demonstrated and assessed seemed to be an 
ongoing dilemna both in the Consortium and nationwide. At the 1973 AEF^ A meeting 
several persons addressed the problem. 

12. Field testing of modules took place in courses and revisions were made. 

13. Modules were sent to the RT for evaluation and storage. 

14. El^forts were made to prepare information about CBTE for other interested schools. 
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15. Several schools mentioned internal cKfaluation of the CBTE program but only a few 
seemect^o work at the task in any special way. 

It would be an over-generalization to suggest that all the schools followed the aforementioned 
fifteen major activities or that they were followed in that exact order. However, a majority 
of the schools were involvedfin the activities and most activities followed the above order. 
The value of such an oversimplified analysis is that it can be a guide for others, CBTE-bent, 
to consider-not necessarily to follow. 

When asked what remained to be done to accomplish Goal I before the project's end, some 
of the above fifteen items were rementioned for two reasons. First, not all schools were at 
^ the same place in CBTE, although it is very safe to say that no one seemed to be near 
program completion usiij^ Elam's criteria. Second, member schools must have felt that 
repetition of activities was necessary either because of the advent of new faculty or to re- 
inforce earlier CBTE commitments and skills. Most-mentioned^ntinuing activities are: 

" - coia^eration of the revision of the' traditional teacher education program. 

- attendant identification of competencies and writing of new modules. 
" revision of existing modules. ^ 

- continued procurement of software and hardware to be used in modules. 

- field testing, of materials, particularly minicourses which could be used. 

- use of CBTE with more students.^ 

- expanded use of field experiences. 

- development and opei^ationalization of support subsystems particularly management 
with emphasis on module delivery and record keeping. 

> 

- continued attendance at regional or national CBTE meetings. 

- submission of new programs. for state approval. 

The most difficult continuing problem seemed to be the development and operational ization 
of support subsystems -particularly management, with emphasis on module delivery and 
record keeping. Members simply did not have staff, facilities, and sometimes know-how to 
nriake their CBTE programs functional. 

When ^ked what major observable accomplishments have resulted from CBTE efforts 
the following were cited: 

- courses have been rewritten with behavioral objectives 

- modules have been developed to accomplish the behavioral objectives. 

• time limits have been removed from teaching and learning. 

- new courses have been developed (mentioned often were early experiences-simulation, 

* microteaching and human relations). 



more field experiences have been established. 
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^ - there has been greater Cooperation with the community and the local education agencies. 

- some faculty members have gaihed recognition both inside and outside the college 
as experts in CBTE. 

- differentiated staffing has been established in the training program and in the schools. 

- college has been able to gain entrance to or remain in the Teacher Corps. 

All of these perceptions of accopiplishmerit were pot shiared equally, nor was it possible 
to determine whether, in fact ail the claims were truly accomplished. For example, with 
regard to the removal of time limits on courses, sorrfe schools complained that students 
were not motivated to work on the modules inoependently, *at they^ let the work pile 
up, and that often, at the end of the tiuarter, inc^pletes had to be given and/or faculty 
members were deluged by students making frenzied last-ninute efforts to get work in on 
time, a denial of a principle of CBTE. 

The fifth question asked about Goal I was to what extent do you believe you will 
accomplish the ( project s) objectives by June, 19731 The schools which responded directly 
said: 

- 100% 

- AH by June 1, '1973 

- We are trying to find out. We will make every effort to accomplish the goals. 

- We expect to react the objectives. -> 

By then we anticipate accomplishing the objectives. 

. Of the three courses in the professional sequence, all are in some measure competency- 
based now and we are making inroads into the student teaching program. 

- Fully accomplish^ by June 1. ' 

- A prediction seems inappropriate. 

* s 

The sixth question asked respondents to describe the extent to which they had fulfilled 
the proposal promise to develop and utilize management, faculty developnfient and community 
involvement subsystems to support CBTE. Again there is great variation among schools in 
the extent and nature of response to this as to other proposal promises. In view of responses 
to the third-party evaluation questionnaires, it seems safe to say that little man-power 
is available or given to designing, developing and implementing the program in a formal way. 
In addition, nothing was mentioned that would suggest much help was provided the 
Consortium schools for such efforts. Except fot^ early RT efforts stressing one conceptualization 
for developing a t^her education curriculum ahi|mention of PERT and GANTT charts, 
modets for^the subsystems did not appear to be availably, and it could be that schools were . 
not even sure what the subsystems should be like. 

More often respondents either did not answer the question or answered it in such a way 
that it was difficult to determine whether the concept of a management subsystem was 
within their grasp. In February, the Consortium held a meeting wherein a consultant 
described management systems, but members eitiier did not know about the explanation or 
found it too general and theoretical. What members seemed to need was precise knowledge 
about how to get modules to appropriate students at the appropriate time and how to keep 
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atfcounts of where students are in the program. Clearly two orders of the problem were 
present. The members did not seem to have enough help in conceptualization and/or they • 
did not have manpower to allocate to the task. 

When asked to list names and positions of key persons in the CBTE program, professional 
educational personnel predominate, but a wide'range of campus personnel are participating. 
Only one school indicated that among the key persons were local eduction agency personnel. 
Only one school cited state department persons. Research Team (RT) members were named 
as key personnel by some and not mentioned by others. No one answered another part 
of the question which asked, IVhat special efforts were made to improve the qualifications 
of key persons. . . . ? Perhaps this should not be so surprising in that the whole idea of a 
faculty development subsystem seemed not understood, not well-reported, or neglecte;!. . 

The final question under Goal I asked respondents to, in retrospect, make recommendations 
to other schools like their own who are about to enter into CBTE. Here respondents 
answered most readily and^two schools of thought surfaced. One school advocated jumping 
right in: Begin, don't wait until everything is perfect and everyone is happy. Another 
school conservatively argued for slow, cautious movement and suggested'that the following 
advicd be heeded: - 

Make certain that administrative approval and support is committed that will give 
authority and visibility to the CBTE effort. 

• Involve everyone (faculty, students, administration, public schools, state department) 
early and provide fo^interdisciplinary work. 

- Use a systems approach and program evaluation review technique-be certain that all 
activities and events are schedufed and delivered. 

- Be prepared to reallocate resources {money, people, and space). 

- Be realisitic in terms of available resources. ^ ^ 

" - Design a faculty development system which among ^ther things: 

Acquaints all with the CETEM program, supports faculty visits to CBTE 
schools, reviews literature on CBTE, brings consultant help- in CBTE, 
program planning and evaluation, and reinforces or rewards faculty 
involvement 

• Either hire extra staff to free CBTE workers or reduce the present work loads. CBTE 
staff must have time off. 



' Do a pilot program first, based upon revision of current courses. 

Besides jumping right in, the first school of thought would try to get rid of or go around 
persons not supportive, develop a completely new program rather than revise the current 
one, and use CBTE materials which were already made elsewhere rather than develop 
modules on campus. The contjwt between these schools of thought are obvious, interesting, 
and worthy of study to determine what precisely happens when a school goes one route as 
opposed to the other. 



Note: The report from the study continues with elaboration of the findings relative 
to Goals 2,3, and 4. For more specific information, see the total document. 
The P^elopment and Effectiveness of Competency Bteed Teacher Education 
. Profltams in Emerging Institutions, U.S. Department of Health, Education, 
and Welfare, Office of Educatipn, Bureau of Research, Washington, D.C., 
December, 1973, Final Report, No. OEG O-72-0778. 
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